Benchmark
CRAG
Evaluate retrieval-augmented answers to realistic questions across five domains.
Explore the original evidence
Explore the original evaluation, its methods, and reported findings.
Open evalCoverage
About 4,400 question-answer pairs in finance, sports, music, movies, and open domains, with mock web search and knowledge-graph APIs.
Methodology
Systems answer using the supplied retrieval tools; responses are graded perfect, acceptable, missing, or incorrect, with hallucinations penalized.