AI for Data Engineering

256 models ranked for data engineering. Scored with bonuses for JSON mode (structured schemas), reasoning (query optimization), function calling (pipeline orchestration), large context, and large output.

How we rank: composite score (benchmark scores 90%, capabilities 5%, context window 5%) adjusted with use-case-specific capability bonuses.

#1 for Data Eng

Claude Fable 5.1

Anthropic

Best Budget

GPT-5.6 Luna Pro (batch)

256

Total Ranked

242

JSON Mode

256

Reasoning

251

Function Calling

Data Engineering AI - Ranked by DE Score

#	Model	Provider	Score	$/1M Out	Context
1	Claude Fable 5.1Anthropic	Anthropic	96	$50.00	1M
2	Claude Fable 5.1 (batch)Anthropic	Anthropic	96	$25.00	1M
3	Claude Fable 5Anthropic	Anthropic	96	$50.00	1M
4	Claude Fable 5 (batch)Anthropic	Anthropic	96	$25.00	1M
5	Claude Opus 5.5Anthropic	Anthropic	95	$20.00	1M
6	Claude Opus 5Anthropic	Anthropic	95	$25.00	1M
7	Claude Opus 4.8Anthropic	Anthropic	95	$25.00	1M
8	Claude Opus 4.7Anthropic	Anthropic	95	$25.00	1M
9	GPT-5.5 ProOpenAI	OpenAI	93	$180.00	1.1M
10	GPT-5.5 Pro (batch)OpenAI	OpenAI	93	$90.00	1.1M
11	GPT-5.5OpenAI	OpenAI	93	$30.00	1.1M
12	GPT-5.4 ProOpenAI	OpenAI	92	$180.00	1.1M
13	GPT-5.4 Pro (batch)OpenAI	OpenAI	92	$90.00	1.1M
14	GPT-5.4OpenAI	OpenAI	92	$15.00	1.1M
15	Gemini 3.1 Pro Preview Custom ToolsGoogle	Google	92	$12.00	1.0M
16	Gemini 3.1 Pro PreviewGoogle	Google	92	$12.00	1.0M
17	Gemini 3.1 Pro Preview (batch)Google	Google	92	$6.00	1.0M
18	GPT-5.3-CodexOpenAI	OpenAI	91	$14.00	400K
19	GPT-5.2-CodexOpenAI	OpenAI	91	$14.00	400K
20	GPT-5.2 ProOpenAI	OpenAI	91	$168.00	400K
21	GPT-5.2 Pro (batch)OpenAI	OpenAI	91	$84.00	400K
22	GPT-5.2OpenAI	OpenAI	91	$14.00	400K
23	Claude Opus 4.6Anthropic	Anthropic	90	$25.00	1M
24	GPT-5.6 Luna ProOpenAI	OpenAI	89	$1.20	1.1M
25	GPT-5.6 Luna Pro (batch)OpenAI	OpenAI	89	$0.60	1.1M
26	GPT-5.6 LunaOpenAI	OpenAI	89	$1.20	1.1M
27	GPT-5.6 Luna (batch)OpenAI	OpenAI	89	$0.60	1.1M
28	GPT-5.6 Terra ProOpenAI	OpenAI	89	$12.00	1.1M
29	GPT-5.6 Terra Pro (batch)OpenAI	OpenAI	89	$6.00	1.1M
30	GPT-5.6 TerraOpenAI	OpenAI	89	$12.00	1.1M

AI for Data Pipelines & ETL

SQL & Query Generation

Generate complex SQL queries, dbt models, and data transformations. JSON mode ensures structured output for automated pipeline integration.

Schema Design & Migration

Design data warehouse schemas, create migration scripts, and manage evolving data models. Reasoning models optimize for query performance and normalization.

Pipeline Orchestration

Generate Airflow DAGs, Prefect flows, and Dagster assets. Function calling enables integration with orchestration APIs and metadata catalogs.

Data Quality & Testing

Create data quality checks, Great Expectations suites, and validation rules. Large context windows handle full schema documentation for comprehensive testing.

Database Data Analysis Data Visualization JSON Output Automation LLM Leaderboard Data Analysis Data Extraction Analytics Science

Frequently Asked Questions

Models generate ETL/ELT code for Apache Spark, dbt, Airflow, and Prefect. Reasoning handles complex transformation logic and data quality rules. Function calling integrates with data catalog APIs. Large context windows process entire pipeline DAGs for optimization suggestions.

Yes, top models generate PySpark and Spark SQL code, optimize join strategies, suggest partitioning schemes, and debug serialization errors. Reasoning is critical for understanding distributed computing patterns and avoiding common pitfalls like data skew.

JSON mode outputs structured data quality rules compatible with Great Expectations and dbt tests. Reasoning identifies edge cases and data anomalies. Function calling enables programmatic data profiling. Large context handles complex schemas with hundreds of columns.

Models design dimensional models (star/snowflake schemas), implement slowly changing dimensions, and generate dbt models with proper materialization strategies. They understand trade-offs between Snowflake, Databricks, and BigQuery architectures.