Benchmark results
See the tests behind each score. They use the benchmark’s original scoring scale.
Agents17 results
Agents' Last Examagents-last-exam · agents
50.4%
ReportedOct 2026
AutomationBenchautomationbench · agents
15.2%
ReportedOct 2026
Big Finance Benchbig-finance-bench · agents
51.0%
ReportedOct 2026
Capture-the-Flag Challenges (Internal)capture-the-flag-challenges · agents
91.8%
ReportedOct 2026
Connectorsopenai-connectors · agents
100.0%
ReportedOct 2026
ExploitGymexploitgym · agents
23.2%
ReportedOct 2026
GeneBench-Progenebench-pro · agents
23.3%
ReportedOct 2026
Internal Research Debugging Evaluationinternal-research-debugging-evaluation · agents
67.8%
ReportedOct 2026
KernelGen 1Pkernelgen-1p · agents
49.2%
ReportedOct 2026
LifeSciBenchlifescibench · agents
56.0%
ReportedOct 2026
Management Consulting Tasks (Internal)management-consulting-tasks · agents
37.2%
ReportedOct 2026
NanoGPTnanogpt · agents
14.5%
ReportedOct 2026
PostTrainBench Liteposttrainbench-lite · agents
51.5%
ReportedOct 2026
RSI Indexrsi-index · agents
56.3%
ReportedOct 2026
Search and Function-Callingopenai-search-function-calling · agents
94.6%
ReportedOct 2026
SEC-bench Prosec-bench-pro · agents
57.7%
ReportedOct 2026
Toolathlontoolathlon · agents
53.1%
ReportedOct 2026
Coding5 results
BenchCADbenchcad · code
62.3%
ReportedOct 2026
BenchCAD (with Python tool)benchcad-with-python-tool · code
78.2%
ReportedOct 2026
DeepSWEdeepswe · code
69.6%
ReportedOct 2026
DeepSWE 1.1deepswe-1.1 · code
70.0%
ReportedOct 2026
ExploitBenchexploitbench · code
52.9%
ReportedOct 2026
General intelligence2 results
Artificial Analysisartificial-analysis · general
55.0%
ReportedOct 2026
GDP.pdfgdp-pdf · general
24.7%
ReportedOct 2026
Healthcare4 results
HealthBenchhealthbench · healthcare
57.0%
ReportedOct 2026
HealthBench Consensushealthbench-consensus · healthcare
95.1%
ReportedOct 2026
HealthBench Hardhealthbench-hard · healthcare
32.7%
ReportedOct 2026
HealthBench Professionalhealthbench-professional · healthcare
57.7%
ReportedOct 2026
Long Context2 results
MRCR v2 (8-needle, 512K-1M)mrcr-v2-8-needle-512k-1m · long_context
72.5%
ReportedOct 2026
MRCR v2 (8-needle)mrcr-v2-(8-needle) · long_context
89.6%
ReportedOct 2026
Learn what each benchmark measures ↗