Change Significance Tracker
Not all rank changes are meaningful. Some are random noise. This page uses statistical analysis to tell you which model score movements are real trends vs. normal fluctuation, so you know which changes to pay attention to.
Models Analyzed
228
Significant Changes
7
Noise (Not Significant)
221
Both Timeframes
0
What This Means
- 7 of 228 models have score changes that are statistically significant - these are real performance shifts, not random noise.
- 221 models show score changes within their normal variation range - don't read too much into small rank shifts for these models.
- How to use this: When a model's rank changes, check here first. If it's not flagged as significant, the change is likely temporary noise. If it is significant, the model is genuinely improving or declining.
Top Significant Changes (by |Z-Score|)
Real Performance Shifts
7 models whose recent scores deviate enough from their historical average to be considered a real change (not noise). Sorted by how extreme the change is. Z-Score measures how unusual the change is - values beyond ±1.96 mean there's a 95% chance the change is real.
| Model | Current | Z-Score | Direction |
|---|---|---|---|
| Qwen3 30B A3B Instruct 2507Alibaba | 64.1 | 4.47 | Improvement |
| GLM 5.1Zhipu AI | 78.0 | 3.91 | Improvement |
| Qwen3.5 Plus 2026-04-20Alibaba | 74.8 | 3.74 | Improvement |
| Qwen3.7 MaxAlibaba | 74.8 | 3.32 | Improvement |
| GPT-4o (2024-11-20)OpenAI | 71.2 | 2.30 | Improvement |
| Claude Opus 4.7 (Fast)Anthropic | 95.1 | 2.24 | Improvement |
| Claude Sonnet 5Anthropic | 85.2 | 2.24 | Improvement |
Short-Term vs. Sustained Changes
A model changing rank in 24 hours could be a blip. But if it's also moving over 7 days, that's a real trend. Models flagged on both timeframes are the most important to watch - they represent confirmed, sustained performance shifts.
Significant on Both Timeframes(strongest signals)
No models currently significant on both daily and weekly timeframes.
Daily Only(may be noise)
No models with daily-only significance.
Weekly Only(building trend)
Which Models Are Noisy vs. Consistent?
Some models have naturally stable scores - even a small rank change for these models is meaningful. Others have volatile scores that bounce around - they need a bigger shift before you should care. CV% (coefficient of variation) tells you how volatile each model is. Higher = noisier.
Noisiest Models(highest CV% - widest significance thresholds)
| Model | Score | CV% |
|---|---|---|
| Gemma 2 27BGoogle | 77.4 | 48.2% |
| Claude Opus 5 (Fast)Anthropic | 95.1 | 44.5% |
| Claude Opus 5Anthropic | 95.1 | 44.5% |
| Phi 4Microsoft | 60.2 | 43.5% |
| R1DeepSeek | 74.2 | 39.0% |
| Command ACohere | 50.8 | 36.2% |
| GPT-4OpenAI | 64.8 | 36.0% |
| Mixtral 8x22B InstructMistral AI | 63.4 | 35.5% |
| Claude Sonnet 5Anthropic | 85.2 | 35.4% |
| Llama 3.1 70B InstructMeta | 65.3 | 35.4% |
| Llama 3.3 70B InstructMeta | 66.8 | 35.1% |
| Mistral LargeMistral AI | 65.9 | 35.0% |
| MiniMax M2-herMiniMax | 69.1 | 34.9% |
| o3 MiniOpenAI | 75.3 | 33.9% |
| DeepSeek V3DeepSeek | 69.5 | 33.5% |
| GPT-4 Turbo PreviewOpenAI | 64.8 | 32.0% |
| Mistral Large 2407Mistral AI | 65.9 | 31.2% |
| GPT-4o (2024-05-13)OpenAI | 71.2 | 30.9% |
| GLM 5V TurboZhipu AI | 72.3 | 30.6% |
| GPT-4oOpenAI | 71.2 | 30.3% |
Most Consistent Models(lowest CV% - tightest significance thresholds)
| Model | Score | CV% |
|---|---|---|
| Laguna S 2.1poolside | 40.0 | 0.0% |
| Laguna S 2.1 (free)poolside | 40.0 | 0.0% |
| LongCat 2.0Meituan | 40.0 | 0.0% |
| KAT-Coder-Air V2.5Kuaishou | 40.0 | 0.0% |
| KAT-Coder-Pro V2.5Kuaishou | 40.0 | 0.0% |
| Grok Latest~x-ai | 40.0 | 0.0% |
| Aion-3.0-Miniaion-labs | 40.0 | 0.0% |
| Aion-3.0aion-labs | 40.0 | 0.0% |
| Laguna XS 2.1poolside | 40.0 | 0.0% |
| Laguna XS 2.1 (free)poolside | 40.0 | 0.0% |
| Fugu Ultrasakana | 40.0 | 0.0% |
| North Mini Code (free)Cohere | 40.0 | 0.0% |
| Claude Fable Latest~anthropic | 40.0 | 0.0% |
| Nemotron 3.5 Content Safety (free)NVIDIA | 40.0 | 0.0% |
| Nemotron 3 UltraNVIDIA | 40.0 | 0.0% |
| Nemotron 3 Ultra (free)NVIDIA | 40.0 | 0.0% |
| Step 3.7 FlashStepFun | 40.0 | 0.0% |
| Perceptron Mk1perceptron | 40.0 | 0.0% |
| Ring-2.6-1Tinclusionai | 40.0 | 0.0% |
| GPT Chat LatestOpenAI | 40.0 | 0.0% |
How Significance Is Calculated
Understanding the statistical methodology behind our significance analysis helps you distinguish real performance shifts from random fluctuations.
Statistical Significance
We use z-scores with a 95% confidence threshold (|z| > 1.96). A z-score measures how many standard deviations a model's current score is from its historical baseline. Only changes exceeding 1.96 standard deviations are flagged as statistically significant.
Baseline Score
The baseline is computed as the arithmetic mean of each model's 14-day sparkline data. This rolling average smooths out daily fluctuations and provides a stable reference point for detecting meaningful deviations.
Confidence Intervals
Each model's 95% confidence interval is calculated as baseline ± 1.96 × standard deviation. Scores falling outside this range indicate a statistically meaningful change. The "Confidence" column shows the ± threshold value.
Multi-Timeframe Analysis
Daily (24h) and weekly (7d) rank changes are analyzed separately. Daily significance requires a rank shift of more than 3 positions; weekly requires more than 5. Models significant on both timeframes represent the strongest, most reliable signals.
Noise vs. Signal
The coefficient of variation (CV%) measures relative volatility. High-CV models have naturally noisy scores and require larger absolute changes to be significant. Low-CV models are more predictable, so even small deviations may represent real shifts.
Related
Statistical significance indicates whether a model's rank change represents a real performance shift or is just random noise. We use z-scores with a 95% confidence threshold (|z| > 1.96), meaning a change is only flagged as significant if there is less than a 5% chance it occurred by random variation.
A z-score measures how many standard deviations a model's current score deviates from its historical baseline. It is calculated as (current score - baseline mean) / standard deviation. Values above +1.96 indicate significant improvement, while values below -1.96 indicate significant decline.
The CV% measures a model's relative score volatility. A high CV% means the model's performance fluctuates a lot, requiring larger changes to be statistically significant. A low CV% means the model is very consistent, so even small deviations may represent meaningful shifts. This helps distinguish inherently noisy models from truly changing ones.