Benchmark Verified Performance 81 Mmlu On Mistral Small 3

via “competitive performance on reasoning benchmarks vs gpt-4o and claude 3.5”

Mistral's 123B flagship model rivaling GPT-4o.

Unique: Achieves GPT-4o and Claude 3.5 Sonnet-level performance on major benchmarks with a 123B parameter model, enabling competitive reasoning capability at lower inference cost due to smaller model size and optimized architecture

vs others: More cost-efficient than GPT-4o and Claude 3.5 Sonnet for equivalent reasoning performance, making it ideal for cost-sensitive applications where benchmark-level performance is sufficient