Web Shopping Environment With E Commerce Task Simulation

via “web shopping task environment with e-commerce interaction simulation”

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

Unique: Integrates a full e-commerce simulation (WebShop-based) into AgentBench, enabling agents to complete realistic shopping tasks with product search, comparison, and purchase workflows. Agents must navigate complex web interfaces and make decisions based on product information and constraints.

vs others: More realistic than synthetic shopping tasks because it simulates actual e-commerce workflows with product catalogs and checkout processes, but more controlled than real websites due to simulation.