Benchmark results
See the tests behind each score. They use the benchmark’s original scoring scale.
Agents1 result
Finance Agentfinance-agent · agents
60.7%
ReportedOct 2026
Coding3 results
CyberGymcybergym · code
73.8%
ReportedOct 2026
FrontierSWEfrontierswe · code
56.0%
ReportedOct 2026
OpenRCAopenrca · code
34.9%
ReportedOct 2026
Communication2 results
Tau2 Retailtau2-retail · communication
91.9%
ReportedOct 2026
Tau2 Telecomtau2-telecom · communication
99.3%
ReportedOct 2026
Language1 result
MMMLUmmmlu · language
91.1%
ReportedOct 2026
Legal1 result
Legal Agent Benchmarklegal-agent-benchmark · legal
4.20%
ReportedOct 2026
Long Context1 result
MRCR v2 (8-needle)mrcr-v2-(8-needle) · long_context
76.0%
ReportedOct 2026
Math2 results
AIME 2025aime-2025 · math
99.8%
ReportedOct 2026
LiveBenchlivebench · math
76.3%
ReportedOct 2026
Multimodal1 result
OSWorldosworld · multimodal
72.7%
ReportedOct 2026
Reasoning12 results
ARC-AGI v2arc-agi-v2 · reasoning
68.8%
ReportedOct 2026
BrowseCompbrowsecomp · reasoning
84.0%
ReportedOct 2026
CharXiv-Rcharxiv-r · reasoning
77.4%
ReportedOct 2026
GPQAgpqa · reasoning
91.3%
ReportedOct 2026
Graphwalks BFS >128kgraphwalks-bfs->128k · reasoning
61.5%
ReportedOct 2026
Graphwalks parents >128kgraphwalks-parents->128k · reasoning
95.4%
ReportedOct 2026
Humanity's Last Examhumanity's-last-exam · reasoning
53.1%
ReportedOct 2026
MCP Atlasmcp-atlas · reasoning
62.7%
ReportedOct 2026
SWE-bench Multilingualswe-bench-multilingual · reasoning
77.8%
ReportedOct 2026
SWE-Bench Verifiedswe-bench-verified · reasoning
80.8%
ReportedOct 2026
Terminal-Bench 2.0terminal-bench-2 · reasoning
65.4%
ReportedOct 2026
Vending-Bench 2vending-bench-2 · reasoning
8,017.59
ReportedOct 2026
Safety1 result
FigQAfigqa · safety
78.3%
ReportedOct 2026
Search1 result
DeepSearchQAdeepsearchqa · search
91.3%
ReportedOct 2026
Vision1 result
MMMU-Prommmu-pro · vision
77.3%
ReportedOct 2026
Learn what each benchmark measures ↗