HellaSwag Commonsense NLI Leaderboard
Tests commonsense reasoning by asking models to complete sentences in a natural way. Designed to be trivial for humans but challenging for models.
Why it matters: Fundamental commonsense reasoning test. Saturated for frontier models (>95%) but useful for evaluating smaller models.
Top Model
96%
Llama 3.1 405B
Average Score
93.7%
Across 7 models
Models Tested
7
Metric: accuracy
Human Baseline
95.6%
Score Range: 0%–100%
HellaSwag Scores - Top 7 Models
Ranked by HellaSwag score (%)
Model Rankings
All models with a reported HellaSwag score, ranked by highest accuracy.
About HellaSwag
- Full Name
- HellaSwag Commonsense NLI
- Category
- Reasoning
- Metric
- accuracy (%)
- Score Range
- 0%–100%
- Human Baseline
- 95.6%
- Status
- Saturated
HellaSwag is a standardized evaluation that measures AI model performance on specific tasks. It provides comparable scores across different models, helping developers choose the right model for their needs.
Llama 3.1 405B currently holds the top score on the HellaSwag benchmark. See our full rankings table above for the complete leaderboard with 7 models.
We update benchmark data from multiple sources including HuggingFace open-source model leaderboards and LMArena. Scores are refreshed regularly as new evaluations are published and new models are released.
No. While HellaSwag is an important indicator, real-world performance depends on many factors including pricing, latency, context window, and specific task requirements. We recommend using our composite score which weighs multiple benchmarks and practical factors.