{"passport":{"unfragile":{"@version":"1.0","version":"2026-05","artifact":{"id":"smithery_antbotlab-mac-use-mcp","slug":"antbotlab-mac-use-mcp","name":"mac-use-mcp","type":"mcp","url":"https://github.com/antbotlab/mac-use-mcp","page_url":"https://unfragile.ai/antbotlab-mac-use-mcp","categories":["mcp-servers"],"tags":["mcp","model-context-protocol","smithery:antbotlab/mac-use-mcp"],"pricing":{"model":"open_source","free":true,"starting_price":null},"status":"active","verified":false},"capabilities":[{"id":"smithery_antbotlab-mac-use-mcp__cap_0","uri":"capability://tool.use.integration.macos.screenshot.capture.with.mcp.protocol.binding","name":"macos screenshot capture with mcp protocol binding","description":"Captures full-screen or region-specific screenshots from macOS and returns image data via MCP tool interface. Uses native macOS APIs (likely screencapture or CGImage) to grab pixel data, encodes as base64 or file path, and exposes through standardized MCP tool schema for AI agents to request visual context without subprocess overhead.","intents":["I need my AI agent to see what's currently on the screen to understand the desktop state","I want to capture specific window or region screenshots for visual analysis by an LLM","I need to feed desktop screenshots into a vision model to make decisions about UI automation"],"best_for":["AI agents performing desktop automation workflows","developers building macOS-native AI assistants","teams integrating vision-based UI testing with LLM agents"],"limitations":["Screenshot capture may include sensitive data (passwords, PII) — no built-in redaction or filtering","Region-based captures require precise coordinate specification; no automatic window detection","Performance degrades with high-frequency capture loops (>10 screenshots/second) due to I/O overhead"],"requires":["macOS 13.0 or later","MCP client capable of handling binary/base64 image data","Screen recording permissions granted to the MCP server process"],"input_types":["region coordinates (x, y, width, height)","optional format specification (PNG, JPEG)"],"output_types":["base64-encoded image data","file path to temporary screenshot file"],"categories":["tool-use-integration","image-visual"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_1","uri":"capability://tool.use.integration.mouse.movement.and.click.control.via.mcp","name":"mouse movement and click control via mcp","description":"Provides absolute and relative mouse positioning, click (left/right/middle), double-click, and drag operations through MCP tool interface. Translates agent commands into native macOS event injection (likely using CGEvent APIs) with coordinate mapping and optional velocity/acceleration curves for smooth automation.","intents":["I want my agent to click buttons, links, or UI elements identified from screenshots","I need to move the mouse to specific coordinates and perform drag-and-drop operations","I want to simulate multi-click sequences (double-click, triple-click) for text selection"],"best_for":["AI agents automating GUI workflows on macOS","developers building no-code automation tools powered by LLMs","QA automation teams using AI agents for cross-application testing"],"limitations":["No built-in collision detection — agent must verify target coordinates are valid before clicking","Click timing is synchronous; rapid click sequences may be rate-limited by macOS event queue","Drag operations require explicit start/end coordinates; no gesture recognition or path interpolation","Accessibility permissions required; fails silently if not granted, making debugging difficult"],"requires":["macOS 13.0 or later","Accessibility permissions granted to MCP server process (System Preferences > Security & Privacy > Accessibility)","MCP client with numeric coordinate input support"],"input_types":["x, y coordinates (integers)","click type (left, right, middle, double, triple)","optional drag end coordinates"],"output_types":["success/failure boolean","error message if accessibility denied"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_10","uri":"capability://tool.use.integration.multi.monitor.and.display.management.via.mcp","name":"multi-monitor and display management via mcp","description":"Queries display configuration (monitor count, resolution, position, color profile), retrieves screen bounds for multi-monitor setups, and enables agents to target screenshots or mouse operations to specific displays. Uses macOS display APIs (CGDisplay) to enumerate and query display properties.","intents":["I need my agent to work with multi-monitor setups and target specific displays for screenshots or clicks","I want to query display resolution and positioning to calculate correct coordinates for mouse operations","I need to detect when displays are added/removed or resolution changes to adapt automation workflows"],"best_for":["AI agents operating in multi-monitor environments requiring display-aware automation","developers building automation that must work across different display configurations","teams automating workflows on systems with variable display setups (docking stations, external monitors)"],"limitations":["Display enumeration is static; changes to display configuration (adding/removing monitors) require re-querying","Coordinate systems vary by display arrangement; agent must account for negative coordinates or non-contiguous display layouts","Color profile queries may not reflect actual display capabilities; profile data is metadata only","Some display properties (refresh rate, color depth) may not be queryable on all macOS versions"],"requires":["macOS 13.0 or later","No special permissions required for display queries"],"input_types":["optional display index or identifier","optional display property filter (resolution, position, color-profile)"],"output_types":["list of displays with resolution, position, color profile, refresh rate","primary display identifier","total screen bounds (union of all displays)"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_11","uri":"capability://tool.use.integration.system.preferences.and.settings.access.via.mcp","name":"system preferences and settings access via mcp","description":"Reads system preferences and settings (display brightness, volume, keyboard repeat rate, accessibility settings) through MCP tools using macOS preferences APIs (NSUserDefaults, System Preferences). Enables agents to query and adapt to system configuration without direct file system access.","intents":["I need my agent to check system settings (brightness, volume, accessibility) to adapt automation behavior","I want to detect accessibility settings to ensure automation is compatible with user configuration","I need to query keyboard/mouse settings to adjust automation timing or behavior"],"best_for":["AI agents adapting automation to system configuration and accessibility settings","developers building automation that must respect user preferences","teams automating workflows that depend on specific system settings"],"limitations":["Preference access is read-only; agents cannot modify system settings through MCP","Preference keys are application-specific and not standardized; querying arbitrary preferences may fail","Some preferences require elevated privileges; access may be denied for security-sensitive settings","Preference values may be cached; changes made by user may not be immediately visible to agent"],"requires":["macOS 13.0 or later","Specific preference domain and key names","No special permissions for reading standard preferences; some system preferences may require elevated access"],"input_types":["preference domain (e.g., 'com.apple.universalaccess')","preference key (e.g., 'mouseDriverCursorSize')","optional application bundle ID for app-specific preferences"],"output_types":["preference value (string, number, boolean, or data)","preference data type","error message if preference not found or access denied"],"categories":["tool-use-integration","data-processing-analysis"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_12","uri":"capability://tool.use.integration.audio.playback.and.system.sound.control.via.mcp","name":"audio playback and system sound control via mcp","description":"Plays audio files or system sounds through MCP tools, controls volume, and manages audio output devices. Uses native macOS audio APIs (AVAudioPlayer, AudioToolbox) to handle audio playback without subprocess calls, enabling agents to provide audio feedback or trigger sound-based workflows.","intents":["I need my agent to play notification sounds or audio feedback during automation workflows","I want to control system volume or switch audio output devices as part of automation","I need to play audio files for testing or user notification purposes"],"best_for":["AI agents providing audio feedback during automation workflows","developers building accessibility features that require audio output","teams automating workflows that depend on audio notifications or alerts"],"limitations":["Audio playback is asynchronous; agent cannot determine when playback completes without polling","Volume control affects system volume; affects all applications, not just automation","Audio device switching may fail if device is in use by other applications","Supported audio formats depend on macOS version; not all formats guaranteed to work"],"requires":["macOS 13.0 or later","Audio file path or system sound identifier","Audio output device available (speakers, headphones, etc.)"],"input_types":["audio file path (MP3, WAV, AIFF, etc.)","system sound name (e.g., 'Glass', 'Ping')","volume level (0-100)","optional audio device identifier"],"output_types":["success/failure boolean","current volume level","list of available audio devices","error message if audio file not found or playback failed"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_13","uri":"capability://tool.use.integration.sleep.wake.and.power.management.via.mcp","name":"sleep/wake and power management via mcp","description":"Controls system sleep/wake state, retrieves power status (battery level, charging state, time remaining), and manages power-related settings through MCP tools. Uses macOS power management APIs (IOKit, NSWorkspace) to query and control power state without privileged subprocess calls.","intents":["I need my agent to check battery level and charging status to decide whether to continue automation","I want to prevent system sleep during long-running automation workflows","I need to wake the system or manage power state as part of automation sequences"],"best_for":["AI agents managing power state during long-running automation workflows","developers building battery-aware automation that adapts to power conditions","teams automating workflows on laptops or systems with variable power states"],"limitations":["Sleep prevention requires continuous assertion; assertion is released when MCP server terminates","Battery status queries may be delayed or approximate; not suitable for real-time power monitoring","Wake operations may fail if system is in deep sleep or hibernation","Power management settings are system-wide; changes affect all applications"],"requires":["macOS 13.0 or later","No special permissions for querying power status; sleep prevention may require elevated privileges"],"input_types":["power operation (sleep, wake, prevent-sleep, allow-sleep)","optional sleep duration in seconds"],"output_types":["battery level (0-100)","charging state (charging, discharging, charged)","time remaining on battery (in minutes)","power source (AC, battery)","success/failure boolean for power operations"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_14","uri":"capability://tool.use.integration.notification.and.alert.delivery.via.mcp","name":"notification and alert delivery via mcp","description":"Sends system notifications and alerts to the user through macOS notification center using native notification APIs (NSUserNotification, UNUserNotificationCenter). Enables agents to notify users of automation progress, errors, or completion without blocking automation workflow.","intents":["I need my agent to notify the user when automation completes or encounters errors","I want to send progress updates or status alerts during long-running workflows","I need to prompt the user for confirmation or input through notification interactions"],"best_for":["AI agents providing user feedback during automation workflows","developers building automation that requires user awareness or interaction","teams automating workflows that need to notify users of completion or errors"],"limitations":["Notifications are non-blocking; user may dismiss without reading or acting on them","Notification interaction (clicking buttons) requires user action; agent cannot programmatically respond to user choices","Notification persistence depends on user settings; notifications may be automatically cleared","Notification content is limited to text and basic formatting; no rich media or custom UI"],"requires":["macOS 13.0 or later","Notification permissions granted (usually automatic for MCP server)"],"input_types":["notification title (string)","notification body (string)","notification type (alert, banner, critical)","optional action buttons (title, identifier pairs)","optional sound (system sound name)"],"output_types":["success/failure boolean","notification ID for tracking","error message if notification delivery failed"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_15","uri":"capability://tool.use.integration.file.system.operations.and.finder.integration.via.mcp","name":"file system operations and finder integration via mcp","description":"Performs file system operations (create, delete, move, copy, list) and integrates with Finder through MCP tools. Uses native macOS file APIs (FileManager, NSWorkspace) to manipulate files and reveal them in Finder without shell commands, enabling agents to manage files as part of automation workflows.","intents":["I need my agent to create, delete, or move files as part of automation workflows","I want to reveal files in Finder or open them with specific applications","I need to list directory contents and filter files for processing"],"best_for":["AI agents managing files as part of automation workflows","developers building file management automation integrated with Finder","teams automating workflows that require file system operations"],"limitations":["File operations are synchronous; large file operations may block automation","File permissions may prevent operations; agent must handle permission errors gracefully","File paths must be absolute; relative paths may not resolve correctly","Trash operations are permanent; no undo capability"],"requires":["macOS 13.0 or later","File system permissions for target directories","Absolute file paths"],"input_types":["file operation (create, delete, move, copy, list, reveal)","source file path","destination file path (for move/copy)","optional file attributes (permissions, timestamps)","optional directory filter (file type, name pattern)"],"output_types":["success/failure boolean","list of files (for list operation) with metadata (size, modified date, type)","error message if operation failed"],"categories":["tool-use-integration","automation-workflow","data-processing-analysis"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_16","uri":"capability://tool.use.integration.mcp.protocol.server.with.zero.dependency.deployment","name":"mcp protocol server with zero-dependency deployment","description":"Provides a complete MCP server implementation that exposes all desktop automation capabilities through the Model Context Protocol without external dependencies. Runs as a standalone Node.js process that can be invoked with a single command (npx mac-use-mcp), automatically handling MCP protocol negotiation, tool schema generation, and client communication.","intents":["I want to quickly deploy desktop automation capabilities to any MCP-compatible AI client without complex setup","I need a zero-dependency MCP server that works out-of-the-box on macOS 13+","I want to integrate desktop automation into my AI agent framework using standard MCP protocol"],"best_for":["AI agent developers integrating desktop automation via MCP protocol","teams deploying automation to macOS systems without complex dependency management","developers building multi-tool AI agents that need standardized tool interfaces"],"limitations":["Node.js runtime required; not suitable for Python-only or other language-specific environments","Single-process architecture; no built-in clustering or load balancing for multiple concurrent clients","MCP protocol overhead adds ~50-100ms per tool call due to serialization and protocol handling","No built-in authentication or authorization; relies on network isolation for security"],"requires":["Node.js 18+ (or npx with Node.js available)","macOS 13.0 or later","MCP-compatible AI client (Claude, custom LLM agents, etc.)","Network connectivity between client and MCP server"],"input_types":["MCP tool requests with JSON-serialized parameters"],"output_types":["MCP tool responses with JSON-serialized results","MCP protocol messages (resource updates, notifications)"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_2","uri":"capability://tool.use.integration.keyboard.input.and.hotkey.simulation.via.mcp","name":"keyboard input and hotkey simulation via mcp","description":"Sends individual keystrokes, key combinations (Cmd+C, Shift+Tab), and text input sequences through MCP tools using native macOS event injection. Supports modifier keys (Command, Option, Control, Shift), special keys (Return, Escape, Tab), and text typing with configurable delay between characters to simulate human input speed.","intents":["I need my agent to type text into focused input fields or search boxes","I want to trigger keyboard shortcuts (Cmd+S, Cmd+Z) to control applications","I need to send key sequences for navigation (arrow keys, Page Down) or form submission (Return)"],"best_for":["AI agents filling forms or entering data into web/desktop applications","developers automating keyboard-driven workflows (terminal commands, IDE shortcuts)","teams building AI-powered data entry or content creation tools"],"limitations":["No keyboard layout awareness — assumes QWERTY; non-QWERTY layouts may produce incorrect characters","Character delay simulation is approximate; cannot perfectly match human typing patterns with variable timing","No input validation — agent must ensure target field is focused before typing to avoid misdirected input","Special characters and non-ASCII input may require UTF-8 encoding handling; not all characters guaranteed to work"],"requires":["macOS 13.0 or later","Accessibility permissions granted to MCP server process","Target application must support keyboard input (not all apps accept programmatic key events)"],"input_types":["text string (for typing)","key name (Return, Escape, Tab, ArrowUp, etc.)","modifier combination (Cmd, Option, Control, Shift)","optional character delay in milliseconds"],"output_types":["success/failure boolean","error message if accessibility denied or key invalid"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_3","uri":"capability://tool.use.integration.clipboard.read.write.with.format.preservation.via.mcp","name":"clipboard read/write with format preservation via mcp","description":"Reads and writes clipboard content through MCP tools, supporting plain text, rich text (RTF), HTML, and image data. Uses native macOS pasteboard APIs (NSPasteboard) to handle multiple clipboard formats simultaneously, enabling agents to exchange data with applications via copy-paste operations without file I/O.","intents":["I want my agent to copy text from the clipboard to analyze or process it","I need to paste generated content (code, text, images) into applications via clipboard","I want to preserve formatting when copying rich text or HTML between applications"],"best_for":["AI agents integrating with copy-paste workflows in productivity apps","developers building content generation tools that feed output into existing applications","teams automating data transfer between applications without file system intermediaries"],"limitations":["Clipboard is shared system resource — concurrent clipboard operations from multiple agents may cause race conditions","Image clipboard data requires base64 encoding/decoding; large images may exceed MCP message size limits","No clipboard history — only current clipboard content accessible; previous clipboard states are lost","Format preservation depends on target application support; not all apps handle all clipboard formats"],"requires":["macOS 13.0 or later","MCP client with support for binary/base64 data in tool responses","No special permissions required (clipboard access is standard)"],"input_types":["text string (for write)","format type (text, html, rtf, image)","optional base64-encoded image data"],"output_types":["clipboard content as text or base64-encoded data","format type of current clipboard content","success/failure boolean"],"categories":["tool-use-integration","data-processing-analysis"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_4","uri":"capability://tool.use.integration.window.management.and.focus.control.via.mcp","name":"window management and focus control via mcp","description":"Lists open windows, retrieves window properties (title, position, size, app name), focuses specific windows, and performs window operations (minimize, maximize, close) through MCP tools. Uses macOS Accessibility API (AXUIElement) to query window hierarchy and manage focus without subprocess calls.","intents":["I need my agent to identify which application window is currently active or find a specific window by title","I want to focus a particular application window before sending keyboard or mouse commands to it","I need to get window coordinates and dimensions to target mouse clicks or screenshots to specific windows"],"best_for":["AI agents managing multi-window workflows or switching between applications","developers building window-aware automation that targets specific app windows","teams automating workflows across multiple applications with precise window control"],"limitations":["Window list may be incomplete for hidden or minimized windows; not all windows are enumerable via Accessibility API","Window titles are not guaranteed unique; multiple windows with same title require additional filtering by app name or PID","Window position/size queries may return stale data if windows are being resized by user simultaneously","Some applications (especially sandboxed apps) restrict Accessibility API access; window operations may fail silently"],"requires":["macOS 13.0 or later","Accessibility permissions granted to MCP server process","Target applications must support Accessibility API (most standard macOS apps do)"],"input_types":["window title (partial or full match)","application name (e.g., 'Safari', 'Terminal')","window operation (focus, minimize, maximize, close)","optional PID for precise window identification"],"output_types":["list of windows with title, app name, position, size, PID","focused window info","success/failure boolean for window operations"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_5","uri":"capability://tool.use.integration.application.launch.and.process.control.via.mcp","name":"application launch and process control via mcp","description":"Launches applications by bundle identifier or path, retrieves running process list with metadata (PID, memory, CPU), and terminates processes through MCP tools. Uses native macOS process APIs (NSWorkspace, Process Manager) to manage application lifecycle without shell subprocess calls.","intents":["I need my agent to launch a specific application (e.g., Safari, Terminal) before automating it","I want to check if an application is running and get its process ID for window targeting","I need to close or force-quit an application as part of an automation workflow"],"best_for":["AI agents orchestrating multi-application workflows requiring app lifecycle management","developers building automation that depends on specific applications being available","teams automating complex workflows spanning multiple applications with startup/shutdown sequences"],"limitations":["Application launch is asynchronous; agent must implement polling or delays to wait for app to fully load before automating","Bundle identifier lookup may fail for non-standard app installations or third-party apps; requires exact bundle ID","Process termination is forceful (SIGKILL); no graceful shutdown or unsaved data warnings","Process list metadata (memory, CPU) may be approximate or delayed; not suitable for real-time performance monitoring"],"requires":["macOS 13.0 or later","Application bundle identifiers or full paths to executables","No special permissions required for launching standard apps; some system apps may require elevated privileges"],"input_types":["application bundle ID (e.g., 'com.apple.Safari')","application path (e.g., '/Applications/Safari.app')","process ID (PID) for termination","optional launch arguments"],"output_types":["success/failure boolean","process ID of launched application","list of running processes with PID, name, memory, CPU usage","error message if app not found or launch failed"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_6","uri":"capability://tool.use.integration.system.event.monitoring.and.notification.via.mcp","name":"system event monitoring and notification via mcp","description":"Monitors system events (application focus changes, window creation/destruction, clipboard changes) and sends notifications to MCP clients through server-initiated messages or polling endpoints. Uses macOS event stream APIs (CGEventTap, NSWorkspaceNotification) to detect state changes and trigger agent actions reactively.","intents":["I want my agent to react when the user switches to a different application or window","I need to detect when clipboard content changes so my agent can process new data","I want to monitor for specific system events (window opened, app launched) to trigger automation workflows"],"best_for":["AI agents implementing reactive workflows triggered by system state changes","developers building event-driven automation that responds to user actions","teams automating workflows that depend on detecting application or window changes"],"limitations":["Event monitoring requires continuous polling or event stream subscription; adds background CPU overhead","Some events (e.g., clipboard changes) may be delayed or missed if event queue is saturated","Event filtering is coarse-grained; no fine-grained filtering for specific window types or applications","Accessibility permissions required; some events may not be available for sandboxed applications"],"requires":["macOS 13.0 or later","Accessibility permissions for event monitoring","MCP client supporting server-initiated notifications or polling for event updates"],"input_types":["event type filter (app-focus, window-created, clipboard-changed, etc.)","optional application or window name filter"],"output_types":["event notification with timestamp, event type, and context (app name, window title, etc.)","event stream as polling response"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_7","uri":"capability://tool.use.integration.text.selection.and.clipboard.based.content.extraction.via.mcp","name":"text selection and clipboard-based content extraction via mcp","description":"Selects text in focused applications using keyboard shortcuts (Cmd+A, Shift+Arrow keys) or mouse-based selection, copies to clipboard, and retrieves the selected content through MCP. Chains keyboard/mouse operations with clipboard read to extract text without OCR or direct text API access.","intents":["I need my agent to select and extract text from a document or web page for processing","I want to copy highlighted text from an application without direct text API access","I need to extract specific text regions by selecting them with keyboard or mouse commands"],"best_for":["AI agents extracting text content from applications without native text APIs","developers building content extraction workflows using copy-paste automation","teams automating data extraction from legacy applications or web content"],"limitations":["Text selection depends on application support; not all apps respond to standard selection keyboard shortcuts","Extracted text may include formatting codes or invisible characters depending on application","Selection is lossy for complex layouts (tables, multi-column text); extracted text may not preserve structure","Requires focused window and active text field; fails if target is not selectable (images, buttons)"],"requires":["macOS 13.0 or later","Target application with text selection support","Accessibility permissions for keyboard/mouse control"],"input_types":["selection method (select-all, select-line, select-word, mouse-drag)","optional selection parameters (start/end coordinates for drag)"],"output_types":["extracted text content","success/failure boolean"],"categories":["tool-use-integration","data-processing-analysis"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_8","uri":"capability://tool.use.integration.drag.and.drop.file.operations.via.mcp","name":"drag-and-drop file operations via mcp","description":"Performs drag-and-drop operations between applications by simulating mouse down, movement, and release events with file path payloads. Enables agents to move/copy files between Finder windows or drag files into applications (e.g., uploading to web forms) without file system APIs or application-specific drag handlers.","intents":["I need my agent to drag files from Finder into an application window (e.g., upload to web form)","I want to move or copy files between Finder windows using drag-and-drop automation","I need to simulate drag-and-drop interactions for applications that only support this input method"],"best_for":["AI agents automating file management workflows in Finder","developers building file upload automation for web applications","teams automating workflows that depend on drag-and-drop file operations"],"limitations":["Drag-and-drop requires precise coordinate targeting; source and destination windows must be visible and positioned correctly","File path payloads are application-dependent; not all applications accept programmatic drag-and-drop with file paths","Drag operation timing is critical; too-fast operations may not be recognized by target application","No feedback on drop success; agent cannot determine if file was actually accepted by target application"],"requires":["macOS 13.0 or later","Source and destination windows visible on screen","Accessibility permissions for mouse control","Target application supporting drag-and-drop file operations"],"input_types":["source file path(s)","source window coordinates","destination window coordinates","optional operation type (copy, move, link)"],"output_types":["success/failure boolean","error message if operation not supported"],"categories":["tool-use-integration","automation-workflow"],"confidence":0.5,"matches":0,"success_rate":0},{"id":"smithery_antbotlab-mac-use-mcp__cap_9","uri":"capability://tool.use.integration.screen.region.ocr.and.text.recognition.via.mcp","name":"screen region ocr and text recognition via mcp","description":"Performs optical character recognition (OCR) on screenshot regions to extract text from images, UI elements, or documents. Integrates with macOS Vision framework or third-party OCR services to convert image regions into machine-readable text, enabling agents to read text from non-selectable UI elements or scanned documents.","intents":["I need my agent to read text from UI elements that don't support text selection (buttons, labels, images)","I want to extract text from screenshots or scanned documents for processing","I need to recognize and read text in specific screen regions to make decisions about UI automation"],"best_for":["AI agents automating workflows with non-text-selectable UI (images, custom controls)","developers building document processing automation with OCR","teams automating workflows that require reading text from screenshots or scanned content"],"limitations":["OCR accuracy depends on text quality, font, and background; may produce errors for small or stylized text","OCR processing adds latency (typically 100-500ms per region); not suitable for real-time high-frequency text recognition","Language support depends on OCR engine; may not support all languages or scripts","Requires clear region specification; OCR on large regions may be slow and produce noisy results"],"requires":["macOS 13.0 or later","macOS Vision framework (built-in) or third-party OCR service API key","Screen region coordinates for OCR target"],"input_types":["screenshot region coordinates (x, y, width, height)","optional language hint for OCR engine","optional OCR engine selection (Vision, Tesseract, cloud service)"],"output_types":["extracted text string","confidence score (0-1) for OCR accuracy","bounding boxes for recognized text regions"],"categories":["tool-use-integration","image-visual","data-processing-analysis"],"confidence":0.5,"matches":0,"success_rate":0}],"trust":{"score":34,"verified":false,"data_access_risk":"high","permissions":["macOS 13.0 or later","MCP client capable of handling binary/base64 image data","Screen recording permissions granted to the MCP server process","Accessibility permissions granted to MCP server process (System Preferences > Security & Privacy > Accessibility)","MCP client with numeric coordinate input support","No special permissions required for display queries","Specific preference domain and key names","No special permissions for reading standard preferences; some system preferences may require elevated access","Audio file path or system sound identifier","Audio output device available (speakers, headphones, etc.)"],"failure_modes":["Screenshot capture may include sensitive data (passwords, PII) — no built-in redaction or filtering","Region-based captures require precise coordinate specification; no automatic window detection","Performance degrades with high-frequency capture loops (>10 screenshots/second) due to I/O overhead","No built-in collision detection — agent must verify target coordinates are valid before clicking","Click timing is synchronous; rapid click sequences may be rate-limited by macOS event queue","Drag operations require explicit start/end coordinates; no gesture recognition or path interpolation","Accessibility permissions required; fails silently if not granted, making debugging difficult","Display enumeration is static; changes to display configuration (adding/removing monitors) require re-querying","Coordinate systems vary by display arrangement; agent must account for negative coordinates or non-contiguous display layouts","Color profile queries may not reflect actual display capabilities; profile data is metadata only","builder identity is not verified yet","no observed match outcomes yet"],"rank_breakdown":{"adoption":0.05,"quality":0.5,"ecosystem":0.48999999999999994,"match_graph":0.25,"freshness":0.6,"weights":{"adoption":0.25,"quality":0.25,"ecosystem":0.15,"match_graph":0.23,"freshness":0.12}},"observed_outcomes":{"matches":0,"success_rate":0,"avg_confidence":0,"top_intents":[],"last_matched_at":null},"maintenance":{"status":"active","updated_at":"2026-05-24T12:16:25.635Z","last_scraped_at":"2026-05-03T15:19:44.684Z","last_commit":null},"community":{"stars":null,"forks":null,"weekly_downloads":null,"model_downloads":null,"model_likes":null}},"distribution":{"claim_url":"https://unfragile.ai/submit?claim=antbotlab-mac-use-mcp","compare_url":"https://unfragile.ai/compare?artifact=antbotlab-mac-use-mcp"}},"signature":"n8dpqegQQJXTlQ2RK62/J+4HgMOCLoeadwqB6pdLyTB9jO1xX6KBe0RMWycKayMypvHeujY+7/j4irqojgbhDg==","signedAt":"2026-06-20T22:38:05.555Z","signedBy":"unfragile.ai","version":1},"_links":{"self":"https://unfragile.ai/api/v1/passport/antbotlab-mac-use-mcp","artifact":"https://unfragile.ai/antbotlab-mac-use-mcp","verify":"https://unfragile.ai/api/v1/verify?slug=antbotlab-mac-use-mcp","publicKey":"https://unfragile.ai/api/v1/trust-passport-public-key","spec":"https://unfragile.ai/trust","schema":"https://unfragile.ai/schema.json","docs":"https://unfragile.ai/docs"}}