Benchmark results
See the tests behind each score. They use the benchmark’s original scoring scale.
Agents4 results
Finance Agentfinance-agent · agents
53.9%
ReportedOct 2026
Finance Agent v2finance-agent-v2 · agents
53.9%
ReportedOct 2026
OfficeQA Proofficeqa-pro · agents
66.2%
ReportedOct 2026
Toolathlontoolathlon · agents
59.9%
ReportedOct 2026
Coding3 results
CyberGymcybergym · code
78.8%
ReportedOct 2026
DeepSWE 1.1deepswe-1.1 · code
59.0%
ReportedOct 2026
FrontierSWEfrontierswe · code
75.0%
ReportedOct 2026
General intelligence1 result
Includeinclude · general
87.6%
ReportedOct 2026
Healthcare1 result
HealthBench Professionalhealthbench-professional · healthcare
55.8%
ReportedOct 2026
Math1 result
LiveBenchlivebench · math
77.2%
ReportedOct 2026
Multimodal1 result
OSWorld-Verifiedosworld-verified · multimodal
83.4%
ReportedOct 2026
Reasoning14 results
BrowseCompbrowsecomp · reasoning
84.3%
ReportedOct 2026
CharXiv-Rcharxiv-r · reasoning
89.9%
ReportedOct 2026
FrontierCode 1.1frontiercode-1.1 · reasoning
46.5%
ReportedOct 2026
GPQAgpqa · reasoning
93.6%
ReportedOct 2026
Graphwalks BFS >128kgraphwalks-bfs->128k · reasoning
68.1%
ReportedOct 2026
Graphwalks parents >128kgraphwalks-parents->128k · reasoning
83.3%
ReportedOct 2026
Humanity's Last Examhumanity's-last-exam · reasoning
57.9%
ReportedOct 2026
MCP Atlasmcp-atlas · reasoning
82.2%
ReportedOct 2026
SWE-bench Multilingualswe-bench-multilingual · reasoning
84.4%
ReportedOct 2026
SWE-Bench Multimodalswe-bench-multimodal · reasoning
38.4%
ReportedOct 2026
SWE-Bench Proswe-bench-pro · reasoning
69.2%
ReportedOct 2026
SWE-Bench Verifiedswe-bench-verified · reasoning
88.6%
ReportedOct 2026
Terminal-Bench 2.0terminal-bench-2 · reasoning
74.6%
ReportedOct 2026
Terminal-Bench 4.0terminal-bench-4.0 · reasoning
23.6%
ReportedOct 2026
Search1 result
DeepSearchQAdeepsearchqa · search
93.1%
ReportedOct 2026
Vision1 result
ScreenSpot Proscreenspot-pro · vision
87.9%
ReportedOct 2026
Learn what each benchmark measures ↗