dev tools ai

Analyzes test code files to identify selectors and locators (CSS, XPath, accessibility identifiers) and decorates them inline within the VS Code editor with visual indicators showing whether each locator is covered by the dev-tools.ai learning system. Uses AST or regex-based pattern matching to recognize locator syntax across supported frameworks (Selenium, Playwright, Cypress, WebdriverIO) and communicates coverage status via color-coded gutter decorations and inline highlights without requiring manual annotation.

Implements mouse-over tooltip functionality that displays captured screenshots or images of UI elements associated with specific locators in test code. When a developer hovers over a recognized selector or locator, the extension retrieves and renders the visual representation of that element as it appeared during test execution, providing immediate visual context without requiring test re-execution. Images are sourced from the dev-tools.ai system's visual capture database built during prior test runs.

Provides a VS Code status bar icon (pencil icon) that enables developers to view, update, and manage their dev-tools.ai API key without leaving the editor. The extension prompts for API key entry during initial installation, stores the key in a platform-specific location (~/.smartdriver on Linux/macOS, %userprofile%\.smartdriver on Windows), and allows in-editor updates via the status bar UI. The stored key is automatically used by SmartDriver instances when no explicit API key parameter is provided, enabling seamless authentication to the dev-tools.ai cloud service.

Monitors test execution across multiple automation frameworks (Selenium, Playwright, Cypress, WebdriverIO) and learns the visual and structural characteristics of UI elements associated with selectors and locators. The system captures images and metadata during test runs, builds a knowledge base of element-to-locator mappings, and uses machine learning to understand which selectors are stable and reliable. This learning enables the system to suggest selector updates or validate existing selectors without manual intervention, reducing test maintenance overhead when UIs change.

Implements pattern recognition and parsing logic to identify and extract locator/selector syntax across multiple test automation frameworks (Python/Java Selenium, Cypress, Playwright, WebdriverIO). The extension recognizes CSS selectors, XPath expressions, accessibility identifiers, and framework-specific locator APIs, enabling it to decorate and hover over recognized locators in test code. Uses language-specific parsing (likely regex or AST-based) to distinguish locators from other code elements and map them to the dev-tools.ai learning system.

Captures screenshots and visual metadata of UI elements during test execution and stores them in a cloud-based database accessible via the dev-tools.ai service. The system associates captured images with specific locators and test execution metadata, enabling the hover preview feature and visual learning system to retrieve and display element images on-demand. Images are indexed and searchable by locator, enabling the extension to quickly retrieve relevant visual context for any selector in test code.

Provides a SmartDriver API that test code can instantiate to interact with the dev-tools.ai learning system. When SmartDriver is instantiated without an explicit API key parameter, the extension automatically injects the stored API key from ~/.smartdriver, enabling seamless authentication without hardcoding credentials in test code. SmartDriver acts as a wrapper or adapter around standard WebDriver APIs, intercepting locator access and element interactions to feed the learning system.

Operates on a freemium pricing model where the VS Code extension is free to install, but core functionality (visual capture, learning system, image storage, API access) depends on a cloud-based dev-tools.ai service that likely has paid tiers. The free tier provides basic locator tracking and decoration, while premium tiers likely offer advanced learning, unlimited image storage, and priority support. All AI processing and data storage occurs in the cloud, requiring internet connectivity and a valid API key for any functionality beyond basic code decoration.

Implements platform-specific API key storage using home directory paths (~/.smartdriver on Linux/macOS, %userprofile%\.smartdriver on Windows) to persist credentials across VS Code sessions. The extension reads and writes API keys to these locations during setup and updates, enabling automatic credential injection into SmartDriver instances without requiring re-entry. Storage is local to the user's machine, not synced across devices or shared with other users.