Vision Based Browser Automation Via Screenshot To Action Mapping

via “headless browser automation with screenshot and dom inspection”

Autonomous AI coding assistant for VS Code — reads, edits, runs commands with human-in-the-loop approval.

Unique: Integrates headless browser automation with screenshot capture and DOM extraction, feeding both visual and structural information to the LLM for reasoning. Actions are gated by approval, and screenshots are captured after each action to provide visual feedback. This combines visual understanding with structured DOM access, which most agents lack.