Realistic Web Environment Task Evaluation

via “web browsing task environment with multi-page navigation and information retrieval”

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Unique: Integrates a web browsing simulation (Mind2Web-based) into AgentBench, enabling agents to navigate multi-page websites and retrieve information through realistic web interactions. Agents must compose search queries, follow links, and extract relevant information from diverse page layouts.

vs others: More realistic than single-page information retrieval because it requires multi-step navigation and search, but more controlled than real web browsing due to simulation and limited page corpus.