Benchmark results
See the tests behind each score. They use the benchmark’s original scoring scale.
Agents3 results
Finance Agentfinance-agent · agents
53.7%
ReportedOct 2026
Finance Agent v2finance-agent-v2 · agents
37.5%
ReportedOct 2026
TAU3-Benchtau3-bench · agents
22.6%
ReportedOct 2026
Chat1 result
Multi-Challengemultichallenge · chat
63.8%
ReportedOct 2026
Coding1 result
PinchBenchpinchbench · code
90.0%
ReportedOct 2026
General intelligence1 result
GDPvalgdpval · general
46.7%
ReportedAug 2026
Instruction Following1 result
IFBenchifbench · instruction_following
81.7%
ReportedOct 2026
Language3 results
MMLU-Prommlu-pro · language
86.8%
ReportedOct 2026
MMLU-ProXmmlu-prox · language
83.0%
ReportedOct 2026
WMT24++wmt24++ · language
83.7%
ReportedOct 2026
Long Context2 results
LongBench v2longbench-v2 · long_context
61.9%
ReportedOct 2026
RULERruler · long_context
94.7%
ReportedOct 2026
Math1 result
IMO-AnswerBenchimo-answerbench · math
92.3%
ReportedOct 2026
Reasoning12 results
AA-LCRaa-lcr · reasoning
65.4%
ReportedOct 2026
Apexapex · reasoning
84.8%
ReportedOct 2026
BrowseCompbrowsecomp · reasoning
44.4%
ReportedOct 2026
CritPTcritpt · reasoning
3.10%
ReportedOct 2026
GPQAgpqa · reasoning
87.0%
ReportedOct 2026
Humanity's Last Examhumanity's-last-exam · reasoning
37.4%
ReportedOct 2026
LiveCodeBench v6livecodebench-v6 · reasoning
89.0%
ReportedOct 2026
ProfBenchprofbench · reasoning
56.0%
ReportedOct 2026
SciCodescicode · reasoning
44.6%
ReportedOct 2026
SWE-bench Multilingualswe-bench-multilingual · reasoning
67.7%
ReportedOct 2026
SWE-Bench Verifiedswe-bench-verified · reasoning
70.7%
ReportedOct 2026
Terminal-Bench 2.1terminal-bench-2.1 · reasoning
56.4%
ReportedOct 2026
Science1 result
OmniScienceomniscience · science
78.7%
ReportedOct 2026
Learn what each benchmark measures ↗