Benchmark results
See the tests behind each score. They use the benchmark’s original scoring scale.
Agents5 results
Agents' Last Examagents-last-exam · agents
31.8%
ReportedOct 2026
AutomationBenchautomationbench · agents
54.8%
ReportedOct 2026
ExploitGymexploitgym · agents
15.3%
ReportedOct 2026
Program Benchprogram-bench · agents
20.3%
ReportedOct 2026
SEC-bench Prosec-bench-pro · agents
62.8%
ReportedOct 2026
Coding3 results
CyberGymcybergym · code
88.1%
ReportedOct 2026
DeepSWE 1.1deepswe-1.1 · code
74.2%
ReportedOct 2026
NL2Reponl2repo · code
64.0%
ReportedOct 2026
Math2 results
CodeForcescodeforces · math
100.0%
ReportedOct 2026
MathArena Apexmatharena-apex · math
65.6%
ReportedOct 2026
Reasoning7 results
GPQAgpqa · reasoning
90.9%
ReportedOct 2026
Humanity's Last Examhumanity's-last-exam · reasoning
36.8%
ReportedOct 2026
Humanity's Last Exam (no tools, text-only)humanity's-last-exam-(no-tools,-text-only) · reasoning
39.1%
ReportedOct 2026
Humanity's Last Exam (with tools)humanity's-last-exam-(with-tools) · reasoning
63.9%
ReportedOct 2026
Terminal-Bench 2.1terminal-bench-2.1 · reasoning
90.6%
ReportedOct 2026
Terminal-Bench 3.0terminal-bench-3.0 · reasoning
30.0%
ReportedOct 2026
Terminal-Bench 4.0terminal-bench-4.0 · reasoning
31.2%
ReportedOct 2026
Vision3 results
BabyVisionbabyvision · vision
89.6%
ReportedOct 2026
Chartographychartography · vision
78.9%
ReportedOct 2026
ZEROBenchzerobench · vision
49.0%
ReportedOct 2026
Learn what each benchmark measures ↗