HumanEval Code Generation 排行榜
164 Python function-generation problems where models must write correct code from docstrings, tested against unit tests. The original code generation benchmark.
为什么重要： The most recognized coding benchmark, though becoming saturated above 90%. Evidence of training data contamination in some models.
顶级模型
97.5%
GPT-5.4
平均评分
88.9%
共49个模型
已测试模型
49
指标: pass@1
人类基准
-
评分范围: 0%–100%
HumanEval Scores - Top 25 Models
Ranked by HumanEval score (%)
模型排名
All models with a reported HumanEval score, ranked by highest pass@1.
关于 HumanEval
- 全名
- HumanEval Code Generation
- 类别
- Coding
- 指标
- pass@1 (%)
- 评分范围
- 0%–100%
- 人类基准
- 尚未确定
- 状态
- 饱和
HumanEval is a standardized evaluation that measures AI model performance on specific tasks. It provides comparable scores across different models, helping developers choose the right model for their needs.
GPT-5.4 currently holds the top score on the HumanEval benchmark. See our full rankings table above for the complete leaderboard with 49 models.
We update benchmark data from multiple sources including HuggingFace open-source model leaderboards and LMArena. Scores are refreshed regularly as new evaluations are published and new models are released.
No. While HumanEval is an important indicator, real-world performance depends on many factors including pricing, latency, context window, and specific task requirements. We recommend using our composite score which weighs multiple benchmarks and practical factors.