People

Simon Willison

Independent open-source developer, Datasette creator, Django co-creator, and writer exploring language models.

Paweł Huryn

The Product Compass

AI product-management educator and builder behind The Product Compass and Bug Hunt Bench.

Phoebe Yao

Pareto AI

Founder of Pareto AI, which develops human expertise and training signals for AI.

Samaya AI

Develops financial research systems and publishes FrontierFinance.

Roboflow

Publishes Vision Evals and tools for testing computer vision models.

Surge AI

Publishes evaluations of professional work, writing, reasoning, and AI agents.

John Yang

Stanford University

Stanford computer-science researcher working on language-model agents, evaluation, synthetic data, and software engineering.

Neel Guha

Columbia Law School

Columbia law professor studying the intersection of AI and law, and a contributor to LegalBench.

Minesh Mathew

Wadhwani AI · IIIT Hyderabad

Machine-learning and computer-vision researcher who co-created DocVQA and works on reading-fluency assessment.

Pareto AI

AI data company and research collaborator on AttuneBench.

OpenAI

Publishes AI research, including the LifeSciBench evaluation of scientific work.

Tacit Labs

Organization affiliated with four co-authors of LifeSciBench.

Akshansh

Co-author of AttuneBench, a benchmark for emotional intelligence in multi-turn AI conversations.

Amelia Liu

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Anand Kannappan

Patronus AI

Co-author of FinanceBench, an evaluation of question answering over financial documents.

Andrew Ho

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Ankita Rathod

Co-author of AttuneBench, a benchmark for emotional intelligence in multi-turn AI conversations.

Anne Marie Droste

Tacit Labs

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Arash Alidoust

Samaya AI

Co-author of FrontierFinance, an evaluation of AI systems for investment research.

Ashwin Paranjape

Samaya AI

AI Lead at Samaya and co-author of FrontierFinance.

Bertie Vidgen

Patronus AI

Co-author of FinanceBench, an evaluation of question answering over financial documents.

C. V. Jawahar

IIIT Hyderabad

IIIT Hyderabad professor and computer-vision researcher; DocVQA co-author.

Columbia Law School

Law school where LegalBench contributor Neel Guha studies AI and law.

Composio

AI integration company publishing evaluations of tool use and multi-app workflows.

Computer Vision Center

Research center associated with DocVQA and document-understanding research.

Contextual AI

Organization affiliated with FinanceBench co-author Douwe Kiela in the original paper.

Craver Corbyn Thomas-Smith

Co-author of AttuneBench, a benchmark for emotional intelligence in multi-turn AI conversations.

David Martin

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Dimosthenis Karatzas

Computer Vision Center · Universitat Autònoma de Barcelona

Computer-vision researcher working on document understanding, robust reading, and vision-language systems; DocVQA co-author.

Douwe Kiela

Contextual AI · Stanford University

Co-author of FinanceBench, an evaluation of question answering over financial documents.

Edmund Wong

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Edward Zhou

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Edwin Chen

Surge AI

Co-author of Riemann-Bench, an evaluation of research-level mathematics.

Erik Knutsen

Surge AI

Co-author of Riemann-Bench, an evaluation of research-level mathematics.

Faisal Sayed

Co-author of AttuneBench, a benchmark for emotional intelligence in multi-turn AI conversations.

GOAT labs

Studies production model behavior and operates PolymarketBench.

IIIT Hyderabad

Research university whose researchers co-authored the original DocVQA benchmark.

Isabelle Zhou

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Joshua Park

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Joy Jiao

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Karina Nguyen

Thoughtful Lab

Co-author of AttuneBench, a benchmark for emotional intelligence in multi-turn AI conversations.

Kate M. Lubrano

Co-author of AttuneBench, a benchmark for emotional intelligence in multi-turn AI conversations.

Katie-Rose Skelly

Tacit Labs

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Kenny Kim

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Kevin Rao

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Mark E. Whiting

Pareto AI

Co-author of AttuneBench, a benchmark for emotional intelligence in multi-turn AI conversations.

Masatoshi Uehara

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Max Marion

Tacit Labs

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Nicole Fitzgerald

Tacit Labs

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Nino Scherrer

Patronus AI

Co-author of FinanceBench, an evaluation of question answering over financial documents.

O. Ozan Koyluoglu

Samaya AI

Co-author of FrontierFinance, an evaluation of AI systems for investment research.

Patronus AI

AI evaluation company that publishes FinanceBench.

Pranab Islam

Patronus AI

Co-author of FinanceBench, an evaluation of question answering over financial documents.

Rachel Dias

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Rebecca Qian

Patronus AI

Co-author of FinanceBench, an evaluation of question answering over financial documents.

Richard Diehl Martinez

Samaya AI

Co-author of FrontierFinance, an evaluation of AI systems for investment research.

Stanford University

Research university associated with contributors to AI coding and evaluation benchmarks.

Stubbi.ai

Notes and experiments with AI tools.

Suhaas Garre

Surge AI

Corresponding author of Riemann-Bench, an evaluation of research-level mathematics.

Sushant Mehta

Surge AI

Co-author of Riemann-Bench, an evaluation of research-level mathematics.

Suyash Shringarpure

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

The Product Compass

AI product-management publication and home of Bug Hunt Bench.

Thejas Venkatesh

Samaya AI

Co-author of FrontierFinance, an evaluation of AI systems for investment research.

Thoughtful Lab

Research collaborator on AttuneBench.

Universitat Autònoma de Barcelona

University associated with DocVQA researchers and document-understanding research.

Vishank Bhatia

Samaya AI

Co-author of FrontierFinance, an evaluation of AI systems for investment research.

Wadhwani AI

Applied AI organization where DocVQA co-creator Minesh Mathew works on reading-fluency assessment.

Yuan Yuan

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Yuhao Zhang

Samaya AI

AI Lead at Samaya and co-author of FrontierFinance.

Yunyun Wang

OpenAI

Co-author of LifeSciBench, an evaluation of realistic life-science research tasks.

Zhiyu Chen

Co-author of FinQA and ConvFinQA, benchmarks for numerical reasoning over financial documents.

The Fin AI

Publishes open financial AI evaluation resources, including FinBen.

Vals AI

Develops evaluations of professional AI work, including financial research agents.

Wells Fargo

Collaborated with Stanford CRFM on HELM Finance.

Shangmin Guo

Co-author of Economics Arena, a study of language models in competitive economic games.

Wenhu Chen

Co-author of FinQA, evaluating numerical reasoning over financial documents.

Charese Smiley

Co-author of FinQA and ConvFinQA, evaluating numerical reasoning over financial documents.

Sameena Shah

Co-author of FinQA and ConvFinQA, evaluating numerical reasoning over financial documents.

Iana Borova

Co-author of FinQA, evaluating numerical reasoning over financial documents.

Dylan Langdon

Co-author of FinQA, evaluating numerical reasoning over financial documents.

Reema Moussa

Co-author of FinQA, evaluating numerical reasoning over financial documents.

Matt Beane

Co-author of FinQA, evaluating numerical reasoning over financial documents.

Ting-Hao Huang

Co-author of FinQA, evaluating numerical reasoning over financial documents.

Bryan Routledge

Co-author of FinQA, evaluating numerical reasoning over financial documents.

William Yang Wang

Co-author of FinQA and ConvFinQA, evaluating numerical reasoning over financial documents.

Shiyang Li

Co-author of ConvFinQA, evaluating numerical reasoning over financial documents.

Zhiqiang Ma

Co-author of ConvFinQA, evaluating numerical reasoning over financial documents.

Haoran Bu

Co-author of Economics Arena, a study of language models in competitive economic games.

Haochuan Wang

Co-author of Economics Arena, a study of language models in competitive economic games.

Yi Ren

Co-author of Economics Arena, a study of language models in competitive economic games.

Dianbo Sui

Co-author of Economics Arena, a study of language models in competitive economic games.

Yuming Shang

Co-author of Economics Arena, a study of language models in competitive economic games.

Siting Lu

Co-author of Economics Arena, a study of language models in competitive economic games.

Di Jin

Co-author of MedQA, a medical-exam question-answering benchmark.

Ankit Pal

Co-author of MedMCQA, a medical multiple-choice question-answering dataset.

Logesh Kumar Umapathi

Co-author of MedMCQA, a medical multiple-choice question-answering dataset.

Malaikannan Sankarasubbu

Co-author of MedMCQA, a medical multiple-choice question-answering dataset.

Qiao Jin

Co-author of PubMedQA and maintainer of its public leaderboard.

Yixing Jiang

Co-author of MedAgentBench, an evaluation of agents using electronic health records.

Samuel Schmidgall

Co-author of AgentClinic, a benchmark for tool-using agents in simulated clinical encounters.

Eileen Pan

Co-author of MedQA, a medical-exam question-answering benchmark.

Nassim Oufattole

Co-author of MedQA, a medical-exam question-answering benchmark.

Wei-Hung Weng

Co-author of MedQA, a medical-exam question-answering benchmark.

Hanyi Fang

Co-author of MedQA, a medical-exam question-answering benchmark.

Peter Szolovits

Co-author of MedQA, a medical-exam question-answering benchmark.

Bhuwan Dhingra

Co-author of PubMedQA, a biomedical research question-answering benchmark.

Zhengping Liu

Co-author of PubMedQA, a biomedical research question-answering benchmark.

William Cohen

Co-author of PubMedQA, a biomedical research question-answering benchmark.

Xinghua Lu

Co-author of PubMedQA, a biomedical research question-answering benchmark.

Kameron C. Black

Co-author of MedAgentBench, a benchmark for agents using electronic health records.

Gloria Geng

Co-author of MedAgentBench, a benchmark for agents using electronic health records.

Danny Park

Co-author of MedAgentBench, a benchmark for agents using electronic health records.

James Zou

Co-author of MedAgentBench, a benchmark for agents using electronic health records.

Andrew Y. Ng

Co-author of MedAgentBench, a benchmark for agents using electronic health records.

Jonathan H. Chen

Co-author of MedAgentBench, a benchmark for agents using electronic health records.

Rojin Ziaei

Co-author of AgentClinic, a benchmark for agents in simulated clinical encounters.

Carl Harris

Co-author of AgentClinic, a benchmark for agents in simulated clinical encounters.

Ji Woong Kim

Co-author of AgentClinic, a benchmark for agents in simulated clinical encounters.

Eduardo Pontes Reis

Co-author of AgentClinic, a benchmark for agents in simulated clinical encounters.

Jeffrey Jopling

Co-author of AgentClinic, a benchmark for agents in simulated clinical encounters.

Michael Moor

Co-author of AgentClinic, a benchmark for agents in simulated clinical encounters.

Sierra

Publishes evaluations of customer-service agents, including τ-bench.

Nicholas Pipitone

Co-author of LegalBench-RAG, an evaluation of retrieval from legal documents.

Ghita Houir Alami

Co-author of LegalBench-RAG, an evaluation of retrieval from legal documents.

Ziru Chen

Co-author of ScienceAgentBench.

Shijie Chen

Co-author of ScienceAgentBench.

FutureHouse

Publishes LAB-Bench to evaluate capabilities used in biology research.

Minyang Tian

Co-author of SciCode.

Luyu Gao

Co-author of SciCode.

Laude Institute

Helps host Terminal-Bench, which evaluates agents on terminal-based work.

Harmanjot Singh

Co-author of CADEngBench.

Abhra Dubey

Co-author of CADEngBench.

Jorge Alejandro Amador Herrera

Co-author of CADEngBench.

UIUC Kang Lab

Publishes CVE-Bench for evaluating agents on web-application vulnerabilities.

Zhun Wang

Co-author of CyberGym.

Tianneng Shi

Co-author of CyberGym.

Jingxuan He

Co-author of CyberGym.

Matthew Cai

Co-author of CyberGym.

Jialin Zhang

Co-author of CyberGym.

Dawn Song

Co-author of CyberGym.

Meta

Publishes Purple Llama and CyberSecEval security evaluations.

CrowdStrike

Collaborated with Meta on CyberSOCEval malware-analysis and threat-intelligence evaluations.

Scale AI

Publishes TutorBench, a rubric-based evaluation of AI tutoring.

Kaushal Kumar Maurya

Co-author of MRBench.

Kv Aditya Srivatsa

Co-author of MRBench.

Kseniia Petukhova

Co-author of MRBench.

Ekaterina Kochmar

Co-author of MRBench.

Shunyu Yao

Co-author of WebShop.

Howard Chen

Co-author of WebShop.

Karthik Narasimhan

Co-author of WebShop.

University of Mannheim · Web-based Systems Group

Develops WebMall for evaluating comparison-shopping agents.

Ralph Peeters

University of Mannheim · Web-based Systems Group

Co-author of WebMall.

Aaron Steiner

University of Mannheim · Web-based Systems Group

Co-author of WebMall.

Luca Schwarz

University of Mannheim · Web-based Systems Group

Co-author of WebMall.

Julian Yuya Caspary

University of Mannheim · Web-based Systems Group

Co-author of WebMall.

Christian Bizer

University of Mannheim · Web-based Systems Group

Co-author of WebMall.

Jing Yu Koh

Co-author of VisualWebArena.

Robert Lo

Co-author of VisualWebArena.

X-PLUG

Publishes WritingBench and its writing-evaluation tools.

Yushi Bai

Co-author of LongWriter, which introduced LongBench-Write.

Jiajie Zhang

Co-author of LongWriter, which introduced LongBench-Write.

Xin Lv

Co-author of LongWriter, which introduced LongBench-Write.

Linzhi Zheng

Co-author of LongWriter, which introduced LongBench-Write.

Siqi Zhu

Co-author of LongWriter, which introduced LongBench-Write.

Lei Hou

Co-author of LongWriter, which introduced LongBench-Write.

Yuxiao Dong

Co-author of LongWriter, which introduced LongBench-Write.

Jie Tang

Co-author of LongWriter, which introduced LongBench-Write.

Juanzi Li

Co-author of LongWriter, which introduced LongBench-Write.

EQ-Bench

Publishes model-judged evaluations of creative writing and emotional intelligence.

MTEB

Open-source community maintaining evaluations and leaderboards for embedding and retrieval systems.

Hugging Face

Open-source AI platform whose audio team maintains the Open ASR Leaderboard.

BigCode

Open research community behind BigCodeBench and other projects for code models.

Kaggle

Platform for data-science competitions, community benchmarks, and Game Arena evaluations.

Google DeepMind

AI research organization that develops the Game Arena evaluation harness with Kaggle.

Gorilla

Research project behind the Berkeley Function Calling Leaderboard and tools for evaluating model tool use.

XLANG Lab

Research group publishing Spider 2.0 for evaluating enterprise database workflows.

Niklas Muennighoff

Coauthor of MTEB and BigCodeBench, evaluating embedding and code models.

Nouamane Tazi

Coauthor of MTEB, an evaluation suite for text embeddings.

Loïc Magne

Coauthor of MTEB, an evaluation suite for text embeddings.

Nils Reimers

Coauthor of MTEB, an evaluation suite for text embeddings.

Frank Liu

RTEB release contributor working on retrieval evaluation.

Kenneth Enevoldsen

RTEB release contributor working on retrieval evaluation.

Solomatin Roman

RTEB release contributor working on retrieval evaluation.

Isaac Chung

RTEB release contributor working on retrieval evaluation.

Tom Aarsen

RTEB release contributor working on retrieval evaluation.

Zoltán Fődi

RTEB release contributor working on retrieval evaluation.

Vaibhav Srivastav

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Steven Zheng

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Eric Bezzam

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Eustache Le Bihan

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Nithin Koluguri

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Piotr Żelasko

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Somshubra Majumdar

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Adel Moumen

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Sanchit Gandhi

Coauthor of the Open ASR Leaderboard paper on speech-recognition evaluation.

Terry Yue Zhuo

Coauthor of BigCodeBench, evaluating practical programming with multiple libraries.

Minh Chien Vu

Coauthor of BigCodeBench, evaluating practical programming with multiple libraries.

Jenny Chim

Coauthor of BigCodeBench, evaluating practical programming with multiple libraries.

Bovard Doerschuk-Tiberi

Coauthor of the Kaggle Game Arena technical report.

Yao Yan

Coauthor of the Kaggle Game Arena technical report.

Will Cukierski

Coauthor of the Kaggle Game Arena technical report.

Meg Risdal

Coauthor of the Kaggle Game Arena technical report.

Naman Jain

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

King Han

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Alex Gu

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Wen-Ding Li

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Fanjia Yan

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Tianjun Zhang

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Sida Wang

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Armando Solar-Lezama

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Koushik Sen

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Ion Stoica

Coauthor of LiveCodeBench, evaluating code models with dated contest problems.

Huanzhi Mao

Coauthor of the BFCL V4 releases evaluating tool use, memory, and web search.

Shishir G. Patil

Coauthor of the BFCL V4 releases evaluating tool use, memory, and web search.

Joseph E. Gonzalez

Coauthor of the BFCL V4 releases evaluating tool use, memory, and web search.

Fangyu Lei

Coauthor of Spider 2.0, evaluating enterprise text-to-SQL workflows.

Jixuan Chen

Coauthor of Spider 2.0, evaluating enterprise text-to-SQL workflows.

Yuxiao Ye

Coauthor of Spider 2.0, evaluating enterprise text-to-SQL workflows.

Ruisheng Cao

Coauthor of Spider 2.0, evaluating enterprise text-to-SQL workflows.

Andrej Karpathy

AI researcher and educator working on neural networks, computer vision, and language models. Former Director of AI at Tesla and a founding member of OpenAI.

Chenglei Si

Coauthor of Design2Code, evaluating screenshot-to-HTML generation.

Yanzhe Zhang

Coauthor of Design2Code, evaluating screenshot-to-HTML generation.

Ryan Li

Coauthor of Design2Code, evaluating screenshot-to-HTML generation.

Zhengyuan Yang

Coauthor of Design2Code, evaluating screenshot-to-HTML generation.

Ruibo Liu

Coauthor of Design2Code, evaluating screenshot-to-HTML generation.

Diyi Yang

Coauthor of Design2Code, evaluating screenshot-to-HTML generation.

Paul Gauthier

Creator of Aider and author of its coding benchmark leaderboards.

SimpleBench Team

Team behind SimpleBench, a benchmark of everyday reasoning and misleading question wording.

François Chollet

Coauthor of ARC-AGI-2, evaluating abstract reasoning on unfamiliar grid tasks.

Mike Knoop

Coauthor of ARC-AGI-2, evaluating abstract reasoning on unfamiliar grid tasks.

Gregory Kamradt

Coauthor of ARC-AGI-2, evaluating abstract reasoning on unfamiliar grid tasks.

Bryan Landers

Coauthor of ARC-AGI-2, evaluating abstract reasoning on unfamiliar grid tasks.

Henry Pinkard

Coauthor of ARC-AGI-2, evaluating abstract reasoning on unfamiliar grid tasks.

ARC Prize Foundation

Nonprofit organization developing the ARC-AGI benchmark series and supporting open research into general intelligence.

Di Wu

Coauthor of LongMemEval, evaluating long-term memory in chat assistants.

Hongwei Wang

Coauthor of LongMemEval, evaluating long-term memory in chat assistants.

Wenhao Yu

Coauthor of LongMemEval, evaluating long-term memory in chat assistants.

Yuwei Zhang

Coauthor of LongMemEval, evaluating long-term memory in chat assistants.

Kai-Wei Chang

Coauthor of LongMemEval, evaluating long-term memory in chat assistants.

Dong Yu

Coauthor of LongMemEval, evaluating long-term memory in chat assistants.

Ziqi Huang

Coauthor of VBench, evaluating generated video.

Yinan He

Coauthor of VBench, evaluating generated video.

Jiashuo Yu

Coauthor of VBench, evaluating generated video.

Fan Zhang

Coauthor of VBench, evaluating generated video.

Yubo Wang

Coauthor of MMLU-Pro, evaluating knowledge and reasoning.

Xueguang Ma

Coauthor of MMLU-Pro, evaluating knowledge and reasoning.

Ge Zhang

Coauthor of MMLU-Pro, evaluating knowledge and reasoning.

Center for AI Safety

Research organization and co-organizer of Humanity’s Last Exam.

Long Phan

Organizing-team member for Humanity’s Last Exam.

Alice Gatti

Organizing-team member for Humanity’s Last Exam.

Ziwen Han

Organizing-team member for Humanity’s Last Exam.

Nathaniel Li

Organizing-team member for Humanity’s Last Exam.

Yuliang Liu

Coauthor of OCRBench.

Zhang Li

Coauthor of OCRBench.

Mingxin Huang

Coauthor of OCRBench.

Biao Yang

Coauthor of OCRBench.

Wenwen Yu

Coauthor of OCRBench.

Chunyuan Li

Coauthor of OCRBench.

Xucheng Yin

Coauthor of OCRBench.

Cheng-lin Liu

Coauthor of OCRBench.

Lianwen Jin

Coauthor of OCRBench.

Xiang Bai

Coauthor of OCRBench.

LlamaIndex

Developer of LlamaExtract and the ExtractBench enterprise document extraction benchmark.

Boyang Zhang

Coauthor of LlamaIndex’s ExtractBench.

Adrian Lyjak

Coauthor of LlamaIndex’s ExtractBench.

Eli Stewart

Coauthor of LlamaIndex’s ExtractBench.

Zhaoqi Li

Coauthor of LlamaIndex’s ExtractBench.

Simon Suo

Coauthor of LlamaIndex’s ExtractBench.

HeyGen

Video technology company and creator of the Code2Video motion-design benchmark with Kaggle.

Abhay Zala

Coauthor of HeyGen’s Code2Video benchmark report.

Miao Yang

Coauthor of HeyGen’s Code2Video benchmark report.

Wenbo Zhu

Coauthor of HeyGen’s Code2Video benchmark report.

Bin Liu

Coauthor of HeyGen’s Code2Video benchmark report.

Aileen Cheng

Coauthor of the FACTS Leaderboard paper.

Alon Jacovi

Coauthor of the FACTS Leaderboard paper.

Amir Globerson

Coauthor of the FACTS Leaderboard paper.

Ben Golan

Coauthor of the FACTS Leaderboard paper.

Lasu Shin

Data scientist and creator of Parsimony.

Subframe

Sponsor of Real Design Benchmark.

Adam Ginzberg

Subframe

Subframe cofounder and creator of Real Design Benchmark.

Exa

Publishes ATLAS, an evaluation of search-intensive agent workflows.

Alexander Goldberg

ATLAS coauthor.

Joshua Ahn

ATLAS coauthor.

Scott Langille

ATLAS coauthor.

Keenable

Maintains NEEDLE, a live evaluation of search APIs.

AssemblyAI

Maintains Voice Standard Bench for language models working with transcripts.

Gamow Labs

Develops agent evaluations for simulated biological laboratory workflows.

Ben Reilly

LabRobotBench coauthor.

Jeff Hsu

LabRobotBench coauthor.

Spacebar

Publishes a pilot comparison of agents maintaining shared work across successive requests.

Jules Kreuer

TabBench-Bio coauthor.

Sofiane Ouaari

TabBench-Bio coauthor.

Julia Hellmig

TabBench-Bio coauthor.

Julius Braitinger

TabBench-Bio coauthor.

Nico Pfeifer

TabBench-Bio coauthor.

SlopCodeBench team

Research collaboration behind SlopCodeBench.

Gabriel Orlanski

SlopCodeBench coauthor.

Devjeet Roy

SlopCodeBench coauthor.

Alexander Yun

SlopCodeBench coauthor.

Changho Shin

SlopCodeBench coauthor.

Albert Ge

SlopCodeBench coauthor.

Dyah Adila

SlopCodeBench coauthor.

Nicholas Roberts

SlopCodeBench coauthor.

Frederic Sala

SlopCodeBench coauthor.

Aws Albarghouthi

SlopCodeBench coauthor.

Cloudish

Maintains AI Deploy Bench for building and deploying apps with coding agents.

Terminal-Bench-Science team

Stanford University · Laude Institute

Research collaboration building expert-contributed scientific workflow evaluations.

Josef Chen

FlavourBench coauthor.

Erim Hayretci

FlavourBench coauthor.

Max Bittker

RuneBench coauthor.

Surya Narreddi

RuneBench coauthor.

Rob Haisfield

RuneBench coauthor.

Sean Lee

RuneBench coauthor.

GitHub

Publishes ReviewBench for evaluating AI code review.

Anne Ouyang

KernelBench coauthor.

Simon Guo

KernelBench coauthor.

Simran Arora

KernelBench coauthor.

Alex L. Zhang

KernelBench coauthor.

William Hu

KernelBench coauthor.

Christopher Ré

KernelBench coauthor.

Azalia Mirhoseini

KernelBench coauthor.

Nick Erickson

TabArena coauthor.

Lennart Purucker

TabArena coauthor.

Andrej Tschalzev

TabArena coauthor.

David Holzmüller

TabArena coauthor.

Prateek Mutalik Desai

TabArena coauthor.

David Salinas

TabArena coauthor.

Frank Hutter

TabArena coauthor.

Andreas Varotsis

Creator of BotBowl Bench.

Aly Moursy

Creator of HieraticBench.

Kilian Lieret

Co-author of SWE-sweep.

Jeffrey Jian Ma

Co-author of SWE-sweep.

Rahul Kindi

Co-author of SWE-sweep.

Yuxiang Wei

Co-author of SWE-sweep.

Jeremy Ma

Co-author of SWE-sweep.

Sten Sootla

Co-author of SWE-sweep.

Parth Thakkar

Co-author of SWE-sweep.

Chao Beyond Zhou

Co-author of SWE-sweep.

Pengcheng Yin

Co-author of SWE-sweep.

Rui Hou

Co-author of SWE-sweep.

Ofir Press

Co-author of SWE-sweep.

jonclegg

Maintainer of the Pac-Man bake-off.

IronBee

Publisher of a raw-model code-review comparison.

Serkan Ozal

Author of IronBee’s raw-model code-review study.

Cliphouse

Publisher of the Motion Graphics Benchmark.

Ruihong Shen

Co-author of 4DCodeBench.

Žiga Kovačič

Co-author of 4DCodeBench.

Peter Kulits

Co-author of 4DCodeBench.

Xingrui Wang

Co-author of 4DCodeBench.

Zizhang Li

Co-author of 4DCodeBench.

Joshua B. Tenenbaum

Co-author of 4DCodeBench.

Alan Yuille

Co-author of 4DCodeBench.

Jieneng Chen

Co-author of 4DCodeBench.

Jiajun Wu

Co-author of 4DCodeBench.

Kapa

Creator of Company Knowledge Bench.

Finn Bauer

Author of the Company Knowledge Bench study.

Pranjal Aggarwal

Co-author of cua-speedrun.

Lawrence Keunho Jang

Co-author of cua-speedrun.

Sean Welleck

Co-author of cua-speedrun.

Daniel Fried

Co-author of cua-speedrun.

Ruslan Salakhutdinov

Co-author of cua-speedrun.

Leah Damon

Co-author of Gamow LabBench.

Daniel McKinnon

Co-author of Gamow LabBench.

aws-bench team

Maintainers of the aws-bench project.

Lean Eval team

Maintainers of the Lean formalization benchmark and leaderboard.