Skip to content

AI Reasoning Benchmark

How do reasoning models stack up against standard LLMs? This benchmark compares 345 reasoning models against 105 standard models on composite score, pricing, and capabilities - helping you decide when chain-of-thought thinking is worth the trade-off.

Reasoning vs Standard - Head-to-Head

Reasoning Models
345
Models
96
Top Score
62
Avg Score
$-2889.83
Avg $/1M Out
Standard Models
105
Models
91
Top Score
57
Avg Score
$-9520.64
Avg $/1M Out

Reasoning models from 51 providers. Score difference: +5 points average for reasoning models.

Reasoning Models - Ranked by Score

#ModelScore
1Claude Fable 5.1Anthropic96
2Claude Fable 5.1 (batch)Anthropic96
3Claude Fable 5Anthropic96
4Claude Fable 5 (batch)Anthropic96
5Claude Opus 5.5Anthropic95
6Claude Opus 5Anthropic95
7Claude Opus 4.8Anthropic95
8Claude Opus 4.7Anthropic95
9GPT-5.5 ProOpenAI93
10GPT-5.5 Pro (batch)OpenAI93
11GPT-5.5OpenAI93
12Gemini 3.1 Pro Preview Custom ToolsGoogle92
13Gemini 3.1 Pro PreviewGoogle92
14Gemini 3.1 Pro Preview (batch)Google92
15GPT-5.4 ProOpenAI92
16GPT-5.4 Pro (batch)OpenAI92
17GPT-5.4OpenAI92
18GPT-5.3-CodexOpenAI91
19GPT-5.2-CodexOpenAI91
20GPT-5.2 ProOpenAI91
21GPT-5.2 Pro (batch)OpenAI91
22GPT-5.2OpenAI91
23Claude Opus 4.6Anthropic90
24GPT-5.6 Luna ProOpenAI89
25GPT-5.6 Luna Pro (batch)OpenAI89
26GPT-5.6 LunaOpenAI89
27GPT-5.6 Luna (batch)OpenAI89
28GPT-5.6 Terra ProOpenAI89
29GPT-5.6 Terra Pro (batch)OpenAI89
30GPT-5.6 TerraOpenAI89
31GPT-5.6 Terra (batch)OpenAI89
32GPT-5.6 Sol ProOpenAI89
33GPT-5.6 Sol Pro (batch)OpenAI89
34GPT-5.6 SolOpenAI89
35GPT-5.6 Sol (batch)OpenAI89
36GPT-5.5 (batch)OpenAI89
37GPT-5.4 (batch)OpenAI89
38Grok 4.7xAI89
39Grok 4.6xAI89
40Grok 4.5xAI89
41Grok 4.3xAI89
42Grok 4.20xAI89
43GPT-5.2 (batch)OpenAI89
44GPT-5.1-Codex-MaxOpenAI89
45GPT-5.1OpenAI89
46GPT-5.1 (batch)OpenAI89
47GPT-5.1-CodexOpenAI89
48GPT-5.1-Codex-MiniOpenAI89
49GPT-5 ProOpenAI89
50GPT-5 Pro (batch)OpenAI89
51GPT-5OpenAI89
52GPT-5 (batch)OpenAI89
53Grok 4.3 (batch)xAI89
54Gemini 3 Flash PreviewGoogle88
55Gemini 3 Flash Preview (batch)Google88
56Grok 4.7 (batch)xAI88
57Grok 4.6 (batch)xAI88
58Grok 4.20 Multi-AgentxAI88
59o3 ProOpenAI87
60o3OpenAI87
61o3 (batch)OpenAI87
62Claude Sonnet 5.5Anthropic85
63Claude Sonnet 5Anthropic85
64Claude Sonnet 4.6Anthropic85
65Claude Opus 4.5Anthropic85
66Claude Opus 4.5 (batch)Anthropic85
67Claude Opus 4.8 (batch)Anthropic84
68Claude Opus 4.7 (batch)Anthropic84
69Claude Opus 4.6 (batch)Anthropic84
70Gemini 2.5 ProGoogle84
71Gemini 2.5 Pro Preview 06-05Google84
72DeepSeek V3.2DeepSeek83
73Claude Opus 4.1 (batch)Anthropic83
74Claude Sonnet 4.5Anthropic82
75Claude Opus 4.1Anthropic82
76GPT-6 AstraOpenAI82
77GPT-6 Astra (batch)OpenAI82
78GPT-6 Astra ProOpenAI82
79GPT-6 Astra Pro (batch)OpenAI82
80o4 Mini (batch)OpenAI81
81Gemini 3.8 FlashGoogle81
82Gemini 3.8 Flash (batch)Google81
83R1 0528DeepSeek79
84GPT-5.4 NanoOpenAI79
85GPT-5.4 Nano (batch)OpenAI79
86GPT-5.4 MiniOpenAI79
87GPT-5.4 Mini (batch)OpenAI79
88Gemini 2.5 Flash LiteGoogle79
89Gemini 2.5 FlashGoogle79
90Gemini 3.5 Flash LiteGoogle79
91Gemini 3.5 Flash Lite (batch)Google79
92Gemini 3.5 FlashGoogle79
93Gemini 3.5 Flash (batch)Google79
94GPT-5 Mini (batch)OpenAI77
95GPT-5 NanoOpenAI77
96GPT-5 Nano (batch)OpenAI77
97Gemma 4 31BGoogle76
98Gemma 4 31B (free)Google76
99Claude Sonnet 4.6 (batch)Anthropic75
100Claude Sonnet 4.5 (batch)Anthropic75
101o3 Mini (batch)OpenAI74
102DeepSeek V3.2 ExpDeepSeek72
103DeepSeek V3.1DeepSeek72
104Gemini 3.1 Flash Lite PreviewGoogle71
105Qwen3.5 397B A17BAlibaba71
106Claude Haiku 5.5Anthropic70
107Claude Haiku 4.5Anthropic70
108Claude Haiku 4.5 (batch)Anthropic70
109Qwen3.5-122B-A10BAlibaba70
110GLM 5.3 FlashX LegalZhipu AI70
111GLM 5.3 FlashXZhipu AI70
112GLM 5.3 FlashZhipu AI70
113GLM 5.3 Flash (batch)Zhipu AI70
114Qwen3.5-27BAlibaba69
115GLM 5V TurboZhipu AI69
116GLM 5.3 PrimeZhipu AI69
117GLM 5.3Zhipu AI69
118GLM 5.3 (batch)Zhipu AI69
119GLM 5.2Zhipu AI69
120Qwen3.5-35B-A3BAlibaba69
121Mistral Large 4Mistral AI68
122GLM 5.1Zhipu AI68
123GLM 5 TurboZhipu AI68
124GLM 5Zhipu AI68
125GLM 4.5VZhipu AI68
126GLM 4.7Zhipu AI67
127GLM 4.6Zhipu AI67
128GLM 4.5Zhipu AI67
129Qwen3.5-9BAlibaba67
130Composer 2Cursor66
131Composer 2 FastCursor66
132Qwen3 235B A22B Thinking 2507Alibaba65
133MiniMax M1MiniMax64
134GLM 4.5 AirZhipu AI64
135MiniMax M2.7MiniMax64
136MiniMax M2.5MiniMax64
137Claude Haiku 5.5 (batch)Anthropic58
138Command A+Cohere52
139Kimi K2.6Moonshot AI48
140Kimi K2.5Moonshot AI48
141GPT-5 MiniOpenAI41
142LFM3-1.7BLiquid AI40
143LFM3-1.7B (free)Liquid AI40
144Hy4Tencent40
145Particle-1particle-ai40
146GPT-6.1 Terra ProOpenAI40
147GPT-6.1 Terra Pro (batch)OpenAI40
148GPT-6.1 TerraOpenAI40
149GPT-6.1 Terra (batch)OpenAI40
150Kimi K3.1 ProMoonshot AI40
151Flint (free)recursive40
152MiniMax M3.1 FlashMiniMax40
153DeepSeek V4.1 Flash 1017DeepSeek40
154Glimpseelorian40
155Xing4.0 29B A4B (free)xingchen-agi40
156Beam 1.0 501B A23Breflection40
157Mercury 3Inception40
158Ternary Bonsai 2 9Bprism-ml40
159Moondream 3 Previewmoondream40
160Moondream 3.1moondream40
161Muse Spark Openmeta40
162Nemotron 3.5 Super VLNVIDIA40
163Nemotron 3.5 Super VL (free)NVIDIA40
164LFM2.5-24B-A2BLiquid AI40
165Gemini 4 ArgonGoogle40
166Gemini 4 Argon (batch)Google40
167Muse Wondermeta40
168Step 5 PreviewStepFun40
169Ling 3.1 Flashinclusionai40
170GPT-6.1 Sol ProOpenAI40
171GPT-6.1 Sol Pro (batch)OpenAI40
172GPT-6.1 SolOpenAI40
173GPT-6.1 Sol (batch)OpenAI40
174Claude Sonnet 5.5 (batch)Anthropic40
175Perceptron Mk1.5perceptron40
176Ember-1fireworks40
177Qwen3.8 Max PrimeAlibaba40
178Aion 3.5 Miniaion-labs40
179Aion 3.5aion-labs40
180Solar Mini 4Upstage40
181GPT-6 Luna ProOpenAI40
182GPT-6 Luna Pro (batch)OpenAI40
183GPT-6 LunaOpenAI40
184GPT-6 Luna (batch)OpenAI40
185GPT-6 Sol ProOpenAI40
186GPT-6 Sol Pro (batch)OpenAI40
187GPT-6 SolOpenAI40
188GPT-6 Sol (batch)OpenAI40
189Claude Opus 5.5 (batch)Anthropic40
190MiMo-V2.6-Pro-UltraSpeedXiaomi40
191MiMo-V2.6-FlashXiaomi40
192MiMo-V2.6-ProXiaomi40
193Qwen3.8 Omni FlashAlibaba40
194Ternary Bonsai 2 27Bprism-ml40
195DeepSeek Pro Latest~deepseek40
196DeepSeek Flash Latest~deepseek40
197GPT Astra Latest~openai40
198GPT Sol Latest~openai40
199GPT Terra Latest~openai40
200GPT Luna Latest~openai40
201Fugu Ultra v2sakana40
202Fugu Maxsakana40
203Ling 3.0 Flash VLinclusionai40
204DeepSeek V4.1 FlashDeepSeek40
205DeepSeek V4.1 Flash (batch)DeepSeek40
206Mercury 2.5Inception40
207Qwen3.8 Max (0902)Alibaba40
208Muse Spark 1.3 Contributormeta40
209Muse Spark 1.3meta40
210Granite 4.2 8BIBM40
211Hy4 previewTencent40
212GLM Flash Latest~z-ai40
213Qwen3.8 FlashAlibaba40
214Muse Spark 1.2 Contributormeta40
215DeepSeek V4 Flash Vision ExpDeepSeek40
216GLM Latest~z-ai40
217Qwen3.8 27BAlibaba40
218Qwen3.8 27B (batch)Alibaba40
219Dots3-Note Preview (free)dots-studio40
220Gemini 3.7 FlashGoogle40
221Gemini 3.7 Flash (batch)Google40
222Seed 2.1 TurboByteDance40
223Qwen3.8 2.4T A95BAlibaba40
224Seed-2.0-CodeByteDance40
225DeepSeek V4 Pro 0813DeepSeek40
226LFM2.5-2.6BLiquid AI40
227LFM2.5-2.6B (free)Liquid AI40
228Nemotron 3.5 LightningNVIDIA40
229Nemotron 3.5 Lightning (free)NVIDIA40
230Sakana Namazusakana40
231Solar Pro 4Upstage40
232Muse Glimmer 30Bmeta40
233Muse Glimmer 30B (batch)meta40
234Ling 3.0 Tinyinclusionai40
235Muse Spark 1.2meta40
236DeepSeek V4 Flash Latest~deepseek40
237DeepSeek V4 Flash 0731DeepSeek40
238DeepSeek V4 Flash 0731 (batch)DeepSeek40
239Inkling Smallthinkingmachines40
240Inkling Small (batch)thinkingmachines40
241Qwen3.7 FlashAlibaba40
242Claude Opus 5 (batch)Anthropic40
243Ling 3.0 Flashinclusionai40
244Gemini 3.6 FlashGoogle40
245Gemini 3.6 Flash (batch)Google40
246LongCat 2.0Meituan40
247Inklingthinkingmachines40
248Kimi K3Moonshot AI40
249Kimi K3 (batch)Moonshot AI40
250Muse Spark 1.1meta40
251Grok Latest~x-ai40
252Aion-3.0-Miniaion-labs40
253Aion-3.0aion-labs40
254Hy3Tencent40
255Jev Routertypesafe40
256Gemini Omni 1.2 FlashGoogle-
257Gemini Omni 1.1 FlashGoogle-
258Crouton Alphastealth-
259Nano Banana 2.1Google-
260Claude Sonnet 5 (batch)Anthropic-
261Nano Banana 2 Lite (Gemini 3.1 Flash Lite Image)Google-
262Fugu Ultrasakana-
263Nano Banana 2 (Gemini 3.1 Flash Image)Google-
264Nano Banana Pro (Gemini 3 Pro Image)Google-
265North Mini Code (free)Cohere-
266Kimi K2.7 CodeMoonshot AI-
267Claude Fable Latest~anthropic-
268Nemotron 3.5 Content SafetyNVIDIA-
269Nemotron 3 UltraNVIDIA-
270Nemotron 3 Ultra (free)NVIDIA-
271Qwen3.7 PlusAlibaba-
272Qwen3.7 Plus (batch)Alibaba-
273MiniMax M3MiniMax-
274MiniMax M3 (batch)MiniMax-
275Step 3.7 FlashStepFun-
276Qwen3.7 MaxAlibaba-
277Grok Build 0.1xAI-
278Perceptron Mk1perceptron-
279Gemini 3.1 Flash LiteGoogle-
280Gemini 3.1 Flash Lite (batch)Google-
281Mistral Medium 3.5Mistral AI-
282Mistral Medium 3.5 (batch)Mistral AI-
283Nemotron 3 Nano Omni (free)NVIDIA-
284Claude Haiku Latest~anthropic-
285GPT Mini Latest~openai-
286Gemini Pro Latest~google-
287Kimi Latest~moonshotai-
288Gemini Flash Latest~google-
289Claude Sonnet Latest~anthropic-
290Qwen3.5 Plus 2026-04-20Alibaba-
291Qwen3.6 FlashAlibaba-
292Qwen3.6 35B A3BAlibaba-
293Qwen3.6 27BAlibaba-
294DeepSeek V4 Pro 0423DeepSeek-
295DeepSeek V4 Flash 0423DeepSeek-
296Hy3 previewTencent-
297MiMo-V2.5-ProXiaomi-
298MiMo-V2.5Xiaomi-
299GPT-5.4 Image 2OpenAI-
300Claude Opus Latest~anthropic-
301Gemma 4 26B A4B Google-
302Gemma 4 26B A4B (free)Google-
303Qwen3.6 PlusAlibaba-
304Mistral Small 4Mistral AI-
305Nemotron 3 SuperNVIDIA-
306Seed-2.0-LiteByteDance-
307Mercury 2Inception-
308Seed-2.0-MiniByteDance-
309Nano Banana 2 (Gemini 3.1 Flash Image Preview)Google-
310Qwen3.5-FlashAlibaba-
311Aion-2.0aion-labs-
312Qwen3.5 Plus 2026-02-15Alibaba-
313Step 3.5 FlashStepFun-
314GLM 4.7 FlashZhipu AI-
315Seed 1.6 FlashByteDance-
316Seed 1.6ByteDance-
317Nemotron 3 Nano 30B A3BNVIDIA-
318GLM 4.6VZhipu AI-
319Nova 2 LiteAmazon-
320Nano Banana Pro (Gemini 3 Pro Image Preview)Google-
321Kimi K2 ThinkingMoonshot AI-
322Sonar Pro SearchPerplexity-
323gpt-oss-safeguard-20bOpenAI-
324GPT-5 Image MiniOpenAI-
325GPT-5 ImageOpenAI-
326Qwen3 VL 30B A3B ThinkingAlibaba-
327DeepSeek V3.1 TerminusDeepSeek-
328gpt-oss-120bOpenAI-
329gpt-oss-120b (batch)OpenAI-
330gpt-oss-20bOpenAI-
331gpt-oss-20b (batch)OpenAI-
332Hunyuan A13B InstructTencent-
333Qwen3 30B A3BAlibaba-
334Qwen3 14BAlibaba-
335Qwen3 32BAlibaba-
336Reka Flash 3rekaai-
337Sonar Reasoning ProPerplexity-
338Sonar Deep ResearchPerplexity-
339SWE-1.5Windsurf-
340Falcon-H1-Arabic 34B InstructTII-
341Falcon-H1-Arabic 7B InstructTII-
342Falcon-H1-Arabic 3B InstructTII-
343Falcon Arabic 7B InstructTII-
344Falcon3 10B InstructTII-
345Falcon3 7B InstructTII-

Top Standard Models (Non-Reasoning) - For Comparison

#ModelScore
1GPT-5.2 ChatOpenAI91
2Gemma 2 27BGoogle77
3GPT-4o (batch)OpenAI72
4DeepSeek V3 0324DeepSeek72
5GPT-4o (2024-11-20)OpenAI71
6GPT-4o (2024-08-06)OpenAI71
7GPT-4oOpenAI71
8GPT-4o (2024-05-13)OpenAI71
9Llama 4 MaverickMeta70
10DeepSeek V3DeepSeek70

Understanding AI Reasoning Benchmarks

What Is Chain-of-Thought?

Chain-of-thought (CoT) prompting enables AI models to break down complex problems into intermediate steps before producing a final answer. Models like OpenAI o1 and DeepSeek R1 internalize this process, generating hidden reasoning traces that dramatically improve accuracy on math, logic, and multi-step tasks compared to direct answering.

When Reasoning Helps

Reasoning models shine on tasks that require multiple logical steps: mathematical proofs, complex coding challenges, scientific analysis, strategic planning, and any problem where standard models tend to hallucinate or skip steps. For simple Q&A or creative writing, standard models are often faster and equally effective.

Speed vs Accuracy

Reasoning models consume more tokens and take longer to respond because they generate internal thinking traces. This trade-off is worthwhile when correctness matters more than latency - for example in code generation, financial analysis, or exam-style problems. For real-time chat, standard models remain the better choice.

Emerging Reasoning Models

The reasoning model landscape is evolving rapidly. OpenAI's o1 and o3 series led the way, followed by DeepSeek R1 bringing open-source reasoning. Google, Anthropic, and other providers have since introduced their own reasoning-capable models, driving down costs and expanding access to chain-of-thought capabilities.

Frequently Asked Questions

AI reasoning benchmarks test a model's ability to solve complex problems requiring logical thinking, mathematical reasoning, scientific analysis, and multi-step problem solving - tasks that go beyond simple pattern matching.

DeepSeek R1, OpenAI o3, and Claude with extended thinking lead on reasoning benchmarks. These models use chain-of-thought processing to break down complex problems into steps, achieving significantly higher accuracy.

Key reasoning benchmarks include GPQA Diamond (graduate-level science), MATH-500 (mathematical reasoning), AIME (competition math), ARC Challenge (science questions), and GSM8K (grade-school math). Each tests different aspects of reasoning ability.

AI Reasoning Benchmark - Which LLM Thinks Best? | LM Market Cap