Evals
7- HellaSwagTest commonsense inference by choosing the most plausible ending to an everyday situation.↗
- WinoGrandeResolve ambiguous pronouns that require commonsense knowledge.↗
- ARC (AI2 Reasoning Challenge)Answer grade-school science questions that resist simple retrieval.↗
- OpenBookQAAnswer science questions that combine a given fact with broader common knowledge.↗
- DROPAnswer reading questions that need counting, sorting, or arithmetic over a paragraph.↗
- IFBenchTest whether models follow new, unseen output constraints.↗
- AI2 Diagrams (AI2D)Evaluate diagram structure understanding and question answering about scientific illustrations.↗