IFEvalifeval · chat
88.7%
ReportedOct 2026
Benchmark results
See the tests behind each score. They use the benchmark’s original scoring scale.
Creativity#224.67 ratingWriting#224.67 ratingEconomics#1014.16 ratingFactuality#120.46 ratingFinance#1828.30 ratingHealthcare#2328.68 ratingInstruction Following#1319.71 ratingLanguage#1130.95 ratingLegal#1327.96 ratingStructured Output#1521.47 rating
Chat3 results
Multi-IFmulti-if · chat
77.5%
ReportedOct 2026
Tau2 Airlinetau2-airline · chat
44.0%
ReportedOct 2026
Communication1 result
Tau2 Retailtau2-retail · communication
71.3%
ReportedOct 2026
Creativity1 result
Creative Writing v3creative-writing-v3 · creativity
87.5%
ReportedOct 2026
Factuality1 result
SimpleQAsimpleqa · factuality
54.3%
ReportedOct 2026
General intelligence6 results
Aider-Polyglotaider-polyglot · general
57.3%
ReportedOct 2026
Arena-Hard v2arena-hard-v2 · general
79.2%
ReportedOct 2026
BFCL-v3bfcl-v3 · general
70.9%
ReportedOct 2026
CSimpleQAcsimpleqa · general
84.3%
ReportedOct 2026
Includeinclude · general
79.5%
ReportedOct 2026
MultiPL-Emultipl-e · general
87.9%
ReportedOct 2026
Language3 results
MMLU-Prommlu-pro · language
83.0%
ReportedOct 2026
MMLU-ProXmmlu-prox · language
79.4%
ReportedOct 2026
MMLU-Reduxmmlu-redux · language
93.1%
ReportedOct 2026
Math4 results
AIME 2025aime-2025 · math
70.3%
ReportedOct 2026
HMMT25hmmt25 · math
55.4%
ReportedOct 2026
LiveBench 20241125livebench-20241125 · math
75.4%
ReportedOct 2026
PolyMATHpolymath · math
50.2%
ReportedOct 2026
Reasoning5 results
ARC-AGIarc-agi · reasoning
41.8%
ReportedOct 2026
GPQAgpqa · reasoning
77.5%
ReportedOct 2026
LiveCodeBench v6livecodebench-v6 · reasoning
51.8%
ReportedOct 2026
SuperGPQAsupergpqa · reasoning
62.6%
ReportedOct 2026
ZebraLogiczebralogic · reasoning
95.0%
ReportedOct 2026
Writing1 result
WritingBenchwritingbench · writing
85.2%
ReportedOct 2026