Hallucination Rate Quantification Across Model Scales

via “hallucination-rate-quantification-across-model-scales”

OpenAI's factuality benchmark for hallucination detection.

Unique: Provides standardized hallucination quantification methodology that enables direct comparison across model families and scales by using consistent unambiguous questions, rather than ad-hoc evaluation approaches that vary by researcher or organization

vs others: More comparable across models than internal evaluation frameworks because it uses a public, fixed benchmark rather than proprietary datasets, enabling reproducible hallucination rate reporting across OpenAI and competing model providers