Unanswerable Question Detection With Confidence Scoring

via “answerability classification with unanswerable question handling”

307K real Google Search queries answered from Wikipedia.

Unique: Explicitly includes unanswerable questions with labels rather than filtering them out, forcing systems to learn rejection as a valid output rather than always attempting answer extraction

vs others: More realistic than QA benchmarks that only include answerable questions, and directly addresses the hallucination problem that production systems face