Windows Ui Element Tree Extraction And State Capture

MCP Server for Computer Use in Windows

Unique: Uses Windows native UI Automation COM APIs instead of computer vision or pixel-based detection, providing reliable element identification across all Windows applications without ML model dependencies. Implements dual-mode capture: standard UI tree for desktop apps and filtered DOM mode for browsers that strips browser UI chrome.

vs others: More reliable than vision-based automation (PyAutoGUI, Selenium screenshot analysis) because it accesses the actual UI element hierarchy rather than inferring from pixels, and works with any LLM without requiring vision capabilities.

via “window-and-element-discovery-via-accessibility-tree”

I've been building computer-use tools for a while, and I quietly launched this about a month ago (122 Stars on GH). I figured it was worth sharing here.Over the last few months, a lot of computer-use agents have come out: Codex, Claude Code, CUA, and others. Most of them seem to work roughly li

Unique: Exposes raw accessibility tree structure as queryable data rather than requiring agents to know exact element IDs or coordinates — enables semantic element discovery based on accessibility metadata (roles, labels, states) that applications provide for assistive technology

vs others: More reliable than image-based UI automation (no OCR errors) and more flexible than coordinate-based clicking because it uses semantic accessibility metadata that persists across UI theme changes and layout adjustments

via “ui element extraction”

Supercharge your AI agents with undetectable, real-browser automation that bypasses Cloudflare, banking portals, and social media blocks. Extract UI elements, intercept network traffic, and perform full network debugging via AI chat with a 98.7% success rate on protected sites. Empower your agents t

Unique: Employs a robust DOM traversal algorithm that adapts to various webpage structures, making it more flexible than static scraping methods.

vs others: More adaptable than XPath-based extraction tools, allowing for easier handling of dynamic web applications.