AI for Data Engineering

241 models ranked for data engineering. Scored with bonuses for JSON mode (structured schemas), reasoning (query optimization), function calling (pipeline orchestration), large context, and large output.

How we rank: composite score (benchmark scores 90%, capabilities 5%, context window 5%) adjusted with use-case-specific capability bonuses.

#1 for Data Eng

241

Total Ranked

214

JSON Mode

241

Reasoning

234

Function Calling

Data Engineering AI - Ranked by DE Score

#	Model	Provider	Score	$/1M Out	Context
1	Claude Fable 5Anthropic	Anthropic	97	$50.00	1M
2	Claude Fable 5 (batch)Anthropic	Anthropic	97	$25.00	1M
3	Claude Opus 5 (Fast)Anthropic	Anthropic	95	$50.00	1M
4	Claude Opus 5Anthropic	Anthropic	95	$25.00	1M
5	Claude Opus 4.8 (Fast)Anthropic	Anthropic	95	$50.00	1M
6	Claude Opus 4.8Anthropic	Anthropic	95	$25.00	1M
7	Claude Opus 4.7 (Fast)Anthropic	Anthropic	95	$150.00	1M
8	Claude Opus 4.7Anthropic	Anthropic	95	$25.00	1M
9	Claude Opus 4.7 (batch)Anthropic	Anthropic	95	$12.50	1M
10	Claude Opus 4.8 (batch)Anthropic	Anthropic	95	$12.50	1M
11	GPT-5.5 ProOpenAI	OpenAI	93	$180.00	1.1M
12	GPT-5.5 Pro (batch)OpenAI	OpenAI	93	$90.00	1.1M
13	GPT-5.5OpenAI	OpenAI	93	$30.00	1.1M
14	GPT-5.5 (batch)OpenAI	OpenAI	93	$15.00	1.1M
15	Gemini 3.1 Pro Preview Custom ToolsGoogle	Google	92	$12.00	1.0M
16	Gemini 3.1 Pro PreviewGoogle	Google	92	$12.00	1.0M
17	Gemini 3.1 Pro Preview (batch)Google	Google	92	$6.00	1.0M
18	GPT-5.4 ProOpenAI	OpenAI	92	$180.00	1.1M
19	GPT-5.4 Pro (batch)OpenAI	OpenAI	92	$90.00	1.1M
20	GPT-5.4OpenAI	OpenAI	92	$15.00	1.1M
21	GPT-5.4 (batch)OpenAI	OpenAI	92	$7.50	1.1M
22	GPT-5.3-CodexOpenAI	OpenAI	91	$14.00	400K
23	GPT-5.2-CodexOpenAI	OpenAI	91	$14.00	400K
24	GPT-5.2 ProOpenAI	OpenAI	91	$168.00	400K
25	GPT-5.2 Pro (batch)OpenAI	OpenAI	91	$84.00	400K
26	GPT-5.2OpenAI	OpenAI	91	$14.00	400K
27	GPT-5.2 (batch)OpenAI	OpenAI	91	$7.00	400K
28	Claude Opus 4.6Anthropic	Anthropic	90	$25.00	1M
29	Claude Opus 4.6 (batch)Anthropic	Anthropic	90	$12.50	1M
30	GPT-5.6 Luna ProOpenAI	OpenAI	89	$0.60	1.1M

AI for Data Pipelines & ETL

SQL & Query Generation

Generate complex SQL queries, dbt models, and data transformations. JSON mode ensures structured output for automated pipeline integration.

Schema Design & Migration

Design data warehouse schemas, create migration scripts, and manage evolving data models. Reasoning models optimize for query performance and normalization.

Pipeline Orchestration

Generate Airflow DAGs, Prefect flows, and Dagster assets. Function calling enables integration with orchestration APIs and metadata catalogs.

Data Quality & Testing

Create data quality checks, Great Expectations suites, and validation rules. Large context windows handle full schema documentation for comprehensive testing.

Database Data Analysis Data Visualization JSON Output Automation LLM Leaderboard Data Analysis Data Extraction Analytics Science

Frequently Asked Questions

Models generate ETL/ELT code for Apache Spark, dbt, Airflow, and Prefect. Reasoning handles complex transformation logic and data quality rules. Function calling integrates with data catalog APIs. Large context windows process entire pipeline DAGs for optimization suggestions.

Yes, top models generate PySpark and Spark SQL code, optimize join strategies, suggest partitioning schemes, and debug serialization errors. Reasoning is critical for understanding distributed computing patterns and avoiding common pitfalls like data skew.

JSON mode outputs structured data quality rules compatible with Great Expectations and dbt tests. Reasoning identifies edge cases and data anomalies. Function calling enables programmatic data profiling. Large context handles complex schemas with hundreds of columns.

Models design dimensional models (star/snowflake schemas), implement slowly changing dimensions, and generate dbt models with proper materialization strategies. They understand trade-offs between Snowflake, Databricks, and BigQuery architectures.