Multi Subject Balanced Evaluation Set Construction

via “multi-subject balanced evaluation set construction”

12.5K competition math problems across 7 subjects and 5 difficulty levels.

Unique: Subject metadata enables programmatic construction of balanced evaluation sets without manual curation. The 7-subject taxonomy provides a natural framework for balancing, unlike datasets with coarse or overlapping categories.

vs others: More flexible than fixed evaluation sets because it supports custom weighting and sampling; more fair than unbalanced datasets because it ensures equal representation across domains; more reproducible than manual curation because sampling is deterministic and can be seeded.