Answer Span Extraction And Evaluation Metrics For Reading Comprehension

95K trivia questions requiring cross-document reasoning.

Unique: Provides multiple valid answer spans per question and ground-truth span annotations within evidence documents, enabling training of span-based extractive QA models with proper handling of answer paraphrasing. The span-level annotations allow fine-grained evaluation of reading comprehension beyond simple answer matching.

vs others: More flexible than SQuAD (which has single answer spans) by allowing multiple valid spans, and more realistic than curated datasets by including noisy documents where answer spans may be paraphrased or implicit

via “span-based answer annotation with character-level indexing”

150K reading comprehension questions including unanswerable ones.

Unique: Uses character-level span indexing rather than token-level, making answers independent of tokenization choices. This enables fair comparison across models with different tokenizers and avoids off-by-one errors from token boundaries.

vs others: More precise than free-form answer generation (which requires BLEU/ROUGE metrics) and more tokenizer-agnostic than token-level span prediction, enabling reproducible evaluation across different model architectures.

via “question-answering via extractive span selection from context”

fill-mask model by undefined. 11,20,072 downloads.

Unique: Implements extractive QA via dual classification heads predicting start/end token positions, leveraging bidirectional context from 24-layer transformer to disambiguate answer boundaries without generating new text, enabling interpretable and hallucination-free answers directly traceable to source passages

vs others: More efficient and interpretable than generative QA models (T5, GPT) for document-based QA, with lower latency and no hallucination risk, but limited to questions answerable by span extraction and requires fine-tuning on QA datasets for competitive performance

via “extractive question-answering with span selection”

question-answering model by undefined. 6,23,377 downloads.

Unique: Fine-tuned specifically on SQuAD v2 dataset which includes unanswerable questions, enabling the model to recognize when no valid answer exists in the context rather than hallucinating answers — a critical distinction from v1-only models that always force an answer

vs others: Outperforms BERT-base on SQuAD v2 benchmarks due to RoBERTa's improved pretraining (robustness to input perturbations, larger batch sizes), while remaining lightweight enough for CPU inference unlike larger models like ELECTRA or DeBERTa

via “extractive question-answering with span prediction”

question-answering model by undefined. 1,16,670 downloads.

Unique: Distilled from BERT-base using knowledge distillation (40% parameter reduction, 60% speedup) while maintaining 97% of original accuracy on SQuAD v1.1, achieved through layer-wise distillation and attention transfer — not just pruning or quantization

vs others: 40% faster inference than BERT-base with minimal accuracy loss, and 3-5x smaller model size than full BERT, making it practical for production QA systems where latency and memory are constraints

via “span-based answer extraction with confidence scoring”

question-answering model by undefined. 1,61,301 downloads.

Unique: Uses independent start/end token classification with softmax scoring over sequence positions, enabling efficient O(n²) span enumeration and confidence-based ranking; confidence computed as product of start/end probabilities rather than joint span probability, making it computationally efficient but potentially miscalibrated

vs others: Faster than generative QA models (no autoregressive decoding); more interpretable than black-box span selection; enables confidence-based filtering unlike models without probability outputs; simpler than pointer networks but less flexible for non-contiguous answers

via “extractive question-answering with span prediction”

question-answering model by undefined. 83,018 downloads.

Unique: Splinter introduces a lightweight span-selection mechanism optimized for efficiency compared to full-sequence generation models; uses a two-pointer approach (start/end token prediction) rather than autoregressive decoding, reducing inference latency by 3-5x versus generative alternatives while maintaining high F1 scores on SQuAD-style benchmarks

vs others: Faster and more deterministic than generative QA models (GPT-based) because it predicts token positions rather than generating sequences, making it ideal for production systems requiring sub-100ms latency and exact source attribution

via “question answering metrics with span and f1 evaluation”

HuggingFace community-driven open-source library of evaluation

Unique: Implements SQuAD-style QA metrics with automatic answer normalization and support for multiple reference answers per question. Computes both exact match (binary) and F1 (token-level overlap) with configurable normalization rules.

vs others: More standard than custom QA metrics because it uses SQuAD-style evaluation; more flexible than single-reference metrics because it supports multiple reference answers.