Benchmark results
See the tests behind each score. They use the benchmark’s original scoring scale.
Agents7 results
Agents' Last Examagents-last-exam · agents
51.2%
ReportedOct 2026
AndroidWorldandroidworld · agents
84.5%
ReportedOct 2026
ClawEval-MMclaw-eval-mm · agents
60.4%
ReportedOct 2026
CoWorkBenchcoworkbench · agents
73.9%
ReportedOct 2026
Job Benchjob-bench · agents
55.7%
ReportedOct 2026
RecreationBenchrecreationbench · agents
49.9%
ReportedOct 2026
Toolathlontoolathlon · agents
73.5%
ReportedOct 2026
Coding3 results
DeepSWE 1.1deepswe-1.1 · code
58.7%
ReportedOct 2026
NL2Reponl2repo · code
48.1%
ReportedOct 2026
Vision2Webvision2web · code
64.0%
ReportedOct 2026
Instruction Following1 result
IFBenchifbench · instruction_following
81.3%
ReportedOct 2026
Math1 result
MathVisionmathvision · math
95.7%
ReportedOct 2026
Multimodal1 result
OSWorld 2.0osworld-2.0 · multimodal
19.4%
ReportedOct 2026
Reasoning6 results
CharXiv-Rcharxiv-r · reasoning
90.6%
ReportedOct 2026
GPQAgpqa · reasoning
91.7%
ReportedOct 2026
Humanity's Last Examhumanity's-last-exam · reasoning
35.9%
ReportedOct 2026
LiveCodeBench v6livecodebench-v6 · reasoning
91.9%
ReportedOct 2026
SWE-bench Multilingualswe-bench-multilingual · reasoning
81.0%
ReportedOct 2026
SWE-Bench Proswe-bench-pro · reasoning
62.5%
ReportedOct 2026
Vision3 results
ERQAerqa · vision
72.3%
ReportedOct 2026
LVBenchlvbench · vision
76.6%
ReportedOct 2026
RealWorldQArealworldqa · vision
88.5%
ReportedOct 2026
Learn what each benchmark measures ↗