Batch Web Scraping With Job Queuing And Result Aggregation

via “batch job discovery and evaluation pipeline”

AI-powered job search system built on Claude Code. 14 skill modes, Go dashboard, PDF generation, batch processing.

Unique: Implements a bash-based batch orchestrator (batch-runner.sh) that manages parallel Claude Code invocations with configurable concurrency limits and result aggregation, treating job discovery and evaluation as a unified pipeline rather than separate steps. Uses portals.yml as a declarative configuration for job sources, enabling users to add new job boards without modifying code.

vs others: Faster than manual job board scraping because batch-runner.sh parallelizes evaluation across multiple JDs; more flexible than job board APIs because it uses Claude Code to parse arbitrary job posting formats; more cost-effective than commercial job aggregators because it leverages Claude's API pricing rather than per-job licensing.