Model Stability Report
Which AI models are the most consistent over time? This report analyzes rank changes, state classifications, and sparkline volatility across 300 tracked models to produce a stability score from 0 to 100.
Rock Solid
10
Consistent
71
Variable
102
Volatile
117
Stability Classification Distribution
Provider Stability Rankings (Avg Score)
Most Stable Models
Top 20 models with the highest stability scores. These models maintain consistent rankings with minimal volatility.
| # | Model | Score | Stability | 24h | 7d |
|---|---|---|---|---|---|
| 1 | Claude Fable 5Anthropic | 97.1 | 100 | 0 | 0 |
| 2 | Claude Opus 4.8 (Fast)Anthropic | 95.1 | 100 | 0 | -1 |
| 3 | Claude Opus 4.8Anthropic | 95.1 | 100 | 0 | -1 |
| 4 | GPT-5.5 ProOpenAI | 92.7 | 100 | 0 | 0 |
| 5 | Falcon-H1-Arabic 34B InstructTII | 40.0 | 100 | 0 | +1 |
| 6 | Falcon-H1-Arabic 7B InstructTII | 40.0 | 100 | 0 | +1 |
| 7 | Falcon-H1-Arabic 3B InstructTII | 40.0 | 100 | 0 | +1 |
| 8 | MiniMax M2.7MiniMax | 78.0 | 95 | 0 | -1 |
| 9 | Claude Opus 4.7 (Fast)Anthropic | 95.1 | 95 | 0 | -5 |
| 10 | GPT-5.3-CodexOpenAI | 90.5 | 93 | 0 | 0 |
| 11 | Claude Opus 4.1Anthropic | 82.1 | 85 | 0 | -2 |
| 12 | Claude Opus 4.7Anthropic | 95.1 | 83 | 0 | -5 |
| 13 | Claude Fable 5 (batch)Anthropic | 97.1 | 79 | 0 | +377 |
| 14 | Claude Opus 4.7 (batch)Anthropic | 95.1 | 79 | 0 | +370 |
| 15 | Claude Opus 4.8 (batch)Anthropic | 94.6 | 79 | 0 | +369 |
| 16 | GPT-5.5 Pro (batch)OpenAI | 92.7 | 79 | 0 | +367 |
| 17 | GPT-5.5 (batch)OpenAI | 92.7 | 79 | 0 | +365 |
| 18 | Gemini 3.1 Pro Preview (batch)Google | 92.2 | 79 | 0 | +362 |
| 19 | GPT-5.4 Pro (batch)OpenAI | 91.9 | 79 | 0 | +360 |
| 20 | GPT-5.4 (batch)OpenAI | 91.9 | 79 | 0 | +358 |
Most Volatile Models
Bottom 20 models with the lowest stability scores. These models show significant ranking fluctuations or inconsistent states.
| # | Model | Score | Stability | 24h | 7d |
|---|---|---|---|---|---|
| 1 | Command R (08-2024)Cohere | 48.7 | 39 | +1 | -62 |
| 2 | Kimi K3Moonshot AI | 40.0 | 44 | 0 | -63 |
| 3 | Command R+ (08-2024)Cohere | 48.7 | 44 | 0 | -63 |
| 4 | Command ACohere | 50.8 | 44 | 0 | -63 |
| 5 | Claude 3 HaikuAnthropic | 51.3 | 44 | 0 | -63 |
| 6 | Kimi K2 0711Moonshot AI | 51.4 | 44 | 0 | -63 |
| 7 | GPT-4o-mini (2024-07-18)OpenAI | 56.5 | 44 | 0 | -64 |
| 8 | gpt-oss-20b (free)OpenAI | 57.4 | 44 | 0 | -64 |
| 9 | Phi 4Microsoft | 60.2 | 44 | 0 | -63 |
| 10 | Qwen3 8BAlibaba | 61.0 | 44 | 0 | -63 |
| 11 | Mixtral 8x22B InstructMistral AI | 63.4 | 44 | 0 | -61 |
| 12 | o3 Mini HighOpenAI | 64.1 | 44 | 0 | -63 |
| 13 | Qwen3 30B A3BAlibaba | 64.1 | 44 | 0 | -63 |
| 14 | Qwen3 30B A3B Thinking 2507Alibaba | 64.1 | 44 | 0 | -59 |
| 15 | Qwen3 235B A22B Instruct 2507Alibaba | 64.7 | 44 | 0 | -61 |
| 16 | GPT-4OpenAI | 64.8 | 44 | 0 | -61 |
| 17 | GPT-4 Turbo PreviewOpenAI | 64.8 | 44 | 0 | -45 |
| 18 | Llama 3.1 70B InstructMeta | 65.3 | 44 | 0 | -60 |
| 19 | Qwen3 235B A22B Thinking 2507Alibaba | 65.5 | 44 | 0 | -60 |
| 20 | Mistral LargeMistral AI | 65.9 | 44 | 0 | -60 |
Stability by Provider
Aggregated stability metrics per provider. Providers are ranked by their average stability score across all models.
| Provider | Models | Avg Stability |
|---|---|---|
| TII | 3 | 100.0 |
| xAI | 5 | 79.0 |
| meta | 2 | 71.1 |
| inclusionai | 5 | 70.0 |
| Anthropic | 28 | 69.6 |
| thinkingmachines | 3 | 65.0 |
| ~deepseek | 1 | 64.0 |
| poolside | 4 | 64.0 |
| Meituan | 1 | 64.0 |
| ~x-ai | 1 | 64.0 |
| sakana | 1 | 64.0 |
| ~anthropic | 4 | 64.0 |
| perceptron | 1 | 64.0 |
| ~openai | 2 | 64.0 |
| 2 | 64.0 | |
| ~moonshotai | 1 | 64.0 |
| OpenAI | 86 | 62.9 |
| Kuaishou | 3 | 62.8 |
| aion-labs | 3 | 62.5 |
| NVIDIA | 9 | 62.4 |
| Tencent | 2 | 61.0 |
| 27 | 60.4 | |
| Amazon | 1 | 59.1 |
| Writer | 1 | 58.5 |
| rekaai | 1 | 58.2 |
| Moonshot AI | 8 | 57.3 |
| MiniMax | 8 | 57.2 |
| Upstage | 1 | 56.6 |
| Inception | 1 | 55.2 |
| StepFun | 2 | 55.2 |
| Zhipu AI | 13 | 53.6 |
| IBM | 1 | 51.8 |
| Alibaba | 31 | 51.2 |
| DeepSeek | 12 | 49.9 |
| ByteDance | 4 | 48.2 |
| Allen AI | 1 | 47.9 |
| Cohere | 4 | 47.8 |
| Xiaomi | 2 | 47.3 |
| arcee-ai | 1 | 46.3 |
| Mistral AI | 6 | 45.2 |
| Cursor | 2 | 44.6 |
| Meta | 5 | 44.4 |
| Microsoft | 1 | 44.0 |
Stability Distribution
How stability scores are distributed across all 300 tracked models.
What Makes a Model Stable?
Our stability scoring system uses three key signals to measure how consistently a model performs over time.
Rank Consistency
The most direct measure of stability. Models lose up to 25 points for large 24-hour rank changes (5 points per rank position moved) and up to 21 points for 7-day changes (3 points per position). Models that hold their rank tightly score higher.
State Classification
Each model has a state reflecting its overall reliability. Models in a "stable" state receive a 10-point bonus, while "fragile" models are penalized 15 points. This captures systemic reliability beyond simple rank movement.
Sparkline Volatility
The 14-day sparkline data reveals hidden volatility. We compute the standard deviation of the sparkline and subtract up to 20 points. Even models that end where they started can be penalized if they oscillated wildly along the way.
Related
The stability score starts at 100 and is reduced based on three factors: 24-hour rank changes (up to -25 points, at 5 per position moved), 7-day rank changes (up to -21 points, at 3 per position), and sparkline volatility measured by standard deviation (up to -20 points). Models in a "stable" state get a +10 bonus, while "fragile" models lose 15 points.
Models are classified into four tiers based on their stability score: "Rock Solid" (85-100) means extremely consistent performance with minimal fluctuation. "Consistent" (70-84) means generally reliable with minor variations. "Variable" (50-69) shows noticeable ranking fluctuations. "Volatile" (below 50) indicates significant instability and unpredictable performance.
Stability indicates how predictably a model will perform over time. A highly rated but volatile model may deliver inconsistent results, which is problematic for production applications requiring reliable output quality. Stable models provide more predictable performance, making them safer choices for mission-critical workloads even if they do not always hold the top rank.