Cross Document Reasoning And Synthesis Evaluation

via “cross-document reasoning and synthesis evaluation”

95K trivia questions requiring cross-document reasoning.

Unique: Explicitly designed to require cross-document reasoning by including multiple supporting documents per question and sourcing from real-world evidence (Wikipedia and web) where synthesis is necessary. Unlike single-document QA datasets (SQuAD, NewsQA), TriviaQA's architecture forces models to retrieve and integrate information across sources, making it a true test of multi-document understanding rather than passage matching.

vs others: Better than HotpotQA for evaluating real-world cross-document reasoning because evidence comes from actual Wikipedia and web sources rather than curated Wikipedia pairs, more closely simulating production RAG scenarios with noisy, heterogeneous documents.