Multi Scale Model Family With Parameter Efficiency Benchmarking

via “example model solutions with multi-size performance reference”

8.5K grade school math problems — multi-step reasoning, verifiable solutions, reasoning benchmark.

Unique: Pre-computed solutions from multiple model sizes in a single standardized file enable direct comparison of how model scale affects reasoning quality without requiring researchers to re-run inference on large models, reducing computational overhead for benchmarking studies

vs others: More convenient than running inference on reference models yourself (no compute cost) but less flexible than dynamic baselines that could be updated as new models emerge