Benchmark
GPQA
Test advanced scientific reasoning with expert-written questions.
Explore the original evidence
Explore the original evaluation, its methods, and reported findings.
Open evalCoverage
448 multiple-choice questions in the original benchmark, covering biology, physics, and chemistry.
Methodology
Measure answer accuracy on a named subset with a specified prompting and sampling setup. Questions were written and reviewed by domain experts.