Unified Benchmark Dataset Management

via “cross-platform problem normalization and schema unification”

10K coding problems across 3 difficulty levels with test suites.

Unique: Implements custom extraction and normalization logic for four distinct online judge platforms with different native formats, rather than using a single-source dataset or generic web scraping

vs others: Unified schema enables consistent evaluation across diverse problem sources without platform-specific branching, whereas single-source benchmarks (HumanEval, MBPP) lack diversity and may have platform-specific biases