Short Form Factual Question Dataset Curation

via “short-form-factual-question-dataset-curation”

OpenAI's factuality benchmark for hallucination detection.

Unique: Explicitly curates for short-form questions with unambiguous answers to isolate factuality measurement, rather than using general QA datasets that mix factuality with reasoning, comprehension, and inference complexity

vs others: Cleaner factuality signal than general QA benchmarks because it removes confounding variables like reasoning complexity, enabling precise attribution of errors to hallucination rather than reasoning failures

via “medical-domain question-answer pair loading and curation”

Dataset by lavita. 5,55,826 downloads.

Unique: Provides a standardized, versioned medical QA dataset hosted on HuggingFace with multi-backend loading support (pandas/polars/MLCroissant), enabling seamless integration into diverse ML workflows without format conversion overhead. The shared-task framing ensures community-driven evaluation and benchmarking standards.

vs others: More accessible and standardized than manually curated medical QA collections; integrates directly with HuggingFace ecosystem (model hub, training frameworks) unlike proprietary medical datasets, reducing setup friction for researchers

via “multiple-choice question-answering dataset curation”

Dataset by allenai. 4,25,151 downloads.

Unique: Combines two distinct question sources (Challenge set from ARC competition + Easy/Medium/Hard tiers from broader corpus) with explicit difficulty stratification and sourcing from real standardized tests rather than synthetic generation, enabling controlled evaluation across reasoning difficulty levels

vs others: Larger and more diverse than SQuAD (extractive QA only) and more grounded in real educational assessments than RACE, making it better suited for evaluating reasoning-heavy multiple-choice understanding

via “general knowledge question answering”