Knowledge Benchmarks
Compare top models across the benchmark suite that best represents knowledge performance. Use this page as the fastest way to inspect the relevant tests, then jump into the full matrix when you want broader context.
3
Benchmarks in category
88
Models with coverage
1
Benchmarks with human baseline
1
Saturated benchmarks
What Is Included
The current benchmark set in this category, with context on what each test captures.
Massive Multitask Language Understanding
SaturatedShows how well a model has absorbed factual knowledge during training. Saturating above 90%, so less useful for differentiating frontier models.
MMLU Professional
Better at differentiating top models since scores are 16-33% lower than standard MMLU. Tests reasoning in addition to knowledge.
SimpleQA Factual Accuracy
GPT-4o scores below 40%, making it surprisingly challenging. Tests honesty and factual reliability, not just knowledge breadth.
Massive Multitask Language Understanding
Tests broad knowledge across 57 academic subjects (STEM, humanities, social sciences) with 16,000 multiple-choice questions. The most widely-cited LLM benchmark.
Why it matters
Shows how well a model has absorbed factual knowledge during training. Saturating above 90%, so less useful for differentiating frontier models.
MMLU Scores (54 models)
How to Read This Page
Performance Tiers
Model Types
Saturated benchmarks have top models clustered above 90%, making them less useful for comparison.
Scores sourced from official model cards, technical reports, and third-party evaluations (Artificial Analysis, LMSYS Arena). Last updated: 2026-08-08T06:30:09.792Z. Some scores are approximate.
AI benchmarks are grouped into categories like coding, math, reasoning, knowledge, and safety. Each category contains multiple standardized tests that measure specific aspects of model performance. This page focuses on one category so you can compare models within a specific skill area.
Each benchmark has its own scoring method - accuracy percentage, pass rate, Elo rating, or normalized score. We display raw scores from official evaluations and community-run tests. Scores are updated hourly as new evaluation results become available.
A saturated benchmark is one where top models score near the maximum (typically above 95%). This means the benchmark no longer effectively differentiates between the best models, and newer, harder benchmarks are needed to measure progress.