Benchmark results
See the tests behind each score. They use the benchmark’s original scoring scale.
Agents7 results
Agents' Last Examagents-last-exam · agents
42.9%
ReportedOct 2026
AndroidWorldandroidworld · agents
81.9%
ReportedOct 2026
ClawEval-MMclaw-eval-mm · agents
56.9%
ReportedOct 2026
CoWorkBenchcoworkbench · agents
70.7%
ReportedOct 2026
Job Benchjob-bench · agents
33.4%
ReportedOct 2026
RecreationBenchrecreationbench · agents
47.1%
ReportedOct 2026
WebArena-Verifiedwebarena-verified · agents
64.8%
ReportedOct 2026
Coding5 results
DeepSWE 1.1deepswe-1.1 · code
42.2%
ReportedOct 2026
NL2Reponl2repo · code
42.3%
ReportedOct 2026
QwenSWEBenchqwen-swe-bench · code
79.0%
ReportedOct 2026
SWE-MMswe-mm · code
38.6%
ReportedOct 2026
Vision2Webvision2web · code
62.9%
ReportedOct 2026
Instruction Following1 result
IFBenchifbench · instruction_following
79.5%
ReportedOct 2026
Math1 result
MathVisionmathvision · math
94.6%
ReportedOct 2026
Multimodal1 result
OSWorld-Verifiedosworld-verified · multimodal
84.3%
ReportedOct 2026
Reasoning7 results
CharXiv-Rcharxiv-r · reasoning
90.2%
ReportedOct 2026
GPQAgpqa · reasoning
89.2%
ReportedOct 2026
Humanity's Last Examhumanity's-last-exam · reasoning
30.8%
ReportedOct 2026
LiveCodeBench v6livecodebench-v6 · reasoning
90.3%
ReportedOct 2026
SWE-Bench Multimodalswe-bench-multimodal · reasoning
38.6%
ReportedAug 2026
SWE-Bench Proswe-bench-pro · reasoning
61.7%
ReportedOct 2026
Terminal-Bench 2.1terminal-bench-2.1 · reasoning
73.0%
ReportedOct 2026
Vision4 results
BabyVisionbabyvision · vision
85.6%
ReportedOct 2026
ERQAerqa · vision
65.5%
ReportedOct 2026
OmniDocBench 1.5omnidocbench-1.5 · vision
91.1%
ReportedOct 2026
RealWorldQArealworldqa · vision
85.9%
ReportedOct 2026
Learn what each benchmark measures ↗