agentseal

Scans the local machine's filesystem to enumerate dangerous AI agent skills and capabilities, analyzing tool definitions, function signatures, and executable permissions to identify security risks before deployment. Works by traversing configured skill directories, parsing skill metadata and schemas, and cross-referencing against a threat database of known dangerous operations (file system access, network calls, code execution). Detects skills that could be exploited via prompt injection or supply chain compromise.

Validates MCP (Model Context Protocol) server configurations for security misconfigurations, malformed schemas, and dangerous parameter bindings. Parses MCP config files, validates tool schemas against JSON Schema standards, checks for unsafe parameter types (shell commands, file paths), and detects overly-permissive tool definitions that could enable privilege escalation. Works by loading config files, performing static analysis on tool definitions, and cross-referencing against known MCP security patterns.

Executes automated prompt injection attacks against configured agents to measure resistance and identify vulnerabilities. Generates adversarial prompts using known injection techniques (prompt breakout, jailbreak patterns, instruction override), sends them to the agent, and analyzes responses to detect if the agent was successfully manipulated into executing unintended actions or revealing sensitive information. Uses a library of injection payloads and pattern matching to detect successful exploits.

Monitors agent dependencies, MCP server sources, and skill packages for signs of supply chain compromise or malicious modifications. Tracks file hashes, version changes, and source integrity, comparing against known-good baselines and checking for suspicious modifications to skill definitions or MCP configs. Detects when dependencies have been updated with potentially malicious code, when MCP servers have been replaced with compromised versions, or when skill definitions have been altered unexpectedly.

Connects to running MCP servers and audits their exposed tools for poisoning, malicious behavior, or unexpected modifications. Introspects tool schemas, tests tool execution with benign inputs, analyzes tool responses for suspicious patterns, and compares against expected behavior baselines. Detects tools that have been replaced with malicious versions, tools with hidden parameters that could be exploited, or tools that execute unexpected side effects.

Identifies skills and tools that perform dangerous operations (file system access, network calls, code execution, privilege escalation) by analyzing tool definitions, function signatures, and parameter types. Uses pattern matching against a curated database of dangerous operation categories and risk levels. Categorizes risks by severity and provides context about why each operation is dangerous and how it could be exploited.

Aggregates findings from all scanning and testing modules into comprehensive security reports with executive summaries, detailed vulnerability listings, risk scoring, and remediation guidance. Generates reports in multiple formats (JSON, HTML, PDF) with customizable detail levels. Includes trend analysis if historical reports are available, showing security posture improvements or regressions over time.

Provides a command-line interface for orchestrating all agentseal security operations, enabling integration into CI/CD pipelines, scheduled security scans, and manual security audits. Supports subcommands for each security module (scan, validate, test, monitor, audit), configuration via CLI flags and config files, and exit codes that enable automated decision-making (fail CI/CD if vulnerabilities found). Enables scripting and automation of security workflows.