Skip to content

GPT-4o (2024-05-13) vs Mistral Large 4

vs
Mistral Large 4

Mistral AI

69#121
Signal-by-Signal Comparison
SignalGPT-4o (2024-05-13)DeltaMistral Large 4
Capabilities
67
-17
83
Benchmarks
72
+3
69
Pricing
85
-13
98
Context window size
81
-14
96
Recency
0
-100
100
Output Capacity
58
-29
87
Overall Result
1 wins
of 6
5 wins
Mistral Large 4 wins 5 of 6 signals

Score History

Score History (39 data points)
GPT-4o (2024-05-13)Mistral Large 4
GPT-4o (2024-05-13)

69.9

current score

Leader

GPT-4o (2024-05-13)

right now

Mistral Large 4

69.1

current score

LMMarketCap.com
Interactive Price Comparison
100Kcalls/month
1,000tokens (~1,333 chars)
500tokens (~667 chars)

GPT-4o (2024-05-13)

OpenAI

Per request$0.012500
Daily$41.67
Monthly$1250.00
Annual$15000.00

Mistral Large 4

Mistral AI

Best Value
Per request$0.001750
Daily$5.83
Monthly$175.00
Annual$2100.00

Mistral Large 4 saves you $1075.00/month

That's $12900.00/year compared to GPT-4o (2024-05-13) at your current usage level of 100K calls/month.

86% cheaper
Choose Mistral Large 4 for cost optimization

GPT-4o (2024-05-13) pricing:
Input:$5.00/M tokens
Output:$15.00/M tokens
Mistral Large 4 pricing:
Input:$0.70/M tokens
Output:$2.10/M tokens
Winner
GPT-4o (2024-05-13)

OpenAI

70

Composite Score

Mistral Large 4

Mistral AI

69

Composite Score

Signal-by-Signal Comparison
MetricGPT-4o (2024-05-13)Mistral Large 4Winner
Overall Score
70
69
GPT-4o (2024-05-13)
Rank#119#121
GPT-4o (2024-05-13)
Quality Rank#119#121
GPT-4o (2024-05-13)
Adoption Rank#119#121
GPT-4o (2024-05-13)
Parameters------
Context Window128K1049K
Mistral Large 4
Pricing$5.00/$15.00/M$0.70/$2.10/M--
Signal Scores
Capabilities
67
83
Mistral Large 4
Benchmarks
72
69
GPT-4o (2024-05-13)
Pricing
85
98
Mistral Large 4
Context window size
81
96
Mistral Large 4
Recency
0
100
Mistral Large 4
Output Capacity
58
87
Mistral Large 4
Benchmark Head-to-Head(15 benchmarks)
GPT-4o (2024-05-13): 7Mistral Large: 2
GPT-4o (2024-05-13)
Mistral Large
Normalized 0-100%
MMLU
88.7%84.7%
MMLU-Pro
72.6%69.4%
GPQA Diamond
53.6%52.5%
MATH-500
76.6%76%
HumanEval
90.2%92%
SWE-bench Verified
30.8%-
GSM8K
95.8%-
IFEval
84.3%86.5%
BBH
83.7%80%
ARC-Challenge
96.4%-
HellaSwag
95.3%-
Arena Elo
12861280
LiveBench
38.3%-
BigCodeBench
51.1%30%
SimpleQA
38.2%-
Benchmark Interpretation

Our score (0-100) is driven by benchmark performance (90%) from Arena Elo ratings, MMLU, GPQA, HumanEval, SWE-bench, and 15+ standardized evaluations. Capabilities and context window serve as tiebreakers (10%). Learn more about our methodology.

GPT-4o (2024-05-13)Competitive

Scores 70/100 (rank #119), placing it in the top 59% of all 290 models tracked.

Raw Quality0/100
Cost Efficiency0/100
Speed0/100
Mistral Large 4Competitive

Scores 69/100 (rank #121), placing it in the top 59% of all 290 models tracked.

Raw Quality0/100
Cost Efficiency0/100
Speed0/100

With only a 1-point gap, these models are in the same performance tier. The practical difference in output quality is minimal - your choice should depend on pricing, latency requirements, and specific feature needs.

When to Use Each Model

Choose GPT-4o (2024-05-13) when you need:

  • Budget-friendly applications with moderate quality requirements

Choose Mistral Large 4 when you need:

  • High-volume production workloads where API costs must be minimized
  • Processing long documents or large codebases (1049K token context)
  • Step-by-step reasoning and chain-of-thought problem solving
  • Self-hosted deployments where you need full control over the model
Cost-Performance Analysis
GPT-4o (2024-05-13)
Input cost$5.00/M tokens
Output cost$15.00/M tokens
Cost per quality point$0.286
Est. monthly (1M tokens/day)$300.00
Mistral Large 4Best Value
Input cost$0.70/M tokens
Output cost$2.10/M tokens
Cost per quality point$0.041
Est. monthly (1M tokens/day)$42.00

Mistral Large 4 offers 86% better value per quality point. At 1M tokens/day, you'd spend $42.00/month with Mistral Large 4 vs $300.00/month with GPT-4o (2024-05-13) - a $258.00 monthly difference.

Latency & Speed
GPT-4o (2024-05-13)Faster
Speed score0/100
Mistral Large 4
Speed score0/100

Both models have comparable response speeds. For most applications, the latency difference is negligible.

When latency matters most: Interactive chatbots, IDE code completion, real-time translation, and user-facing applications where response time directly impacts experience. For batch processing, background summarization, or offline analysis, latency is less critical.

Example Use Cases

Code generation & review

Based on overall model capabilities and architecture for coding tasks like generating functions, debugging, and refactoring

GPT-4o (2024-05-13)

Customer support chatbot

Suitable for user-facing chat with competitive response times. Mistral Large 4 also offers lower per-token costs for high-volume support

GPT-4o (2024-05-13)

Long document analysis

Larger context window (1049K tokens) can process longer documents, contracts, and research papers in a single pass

Mistral Large 4

Batch data extraction

Lower output pricing ($2.10/M) reduces costs when processing thousands of records daily

Mistral Large 4

Creative writing & content

Higher overall composite score (70/100) correlates with better nuance, coherence, and style in long-form content

GPT-4o (2024-05-13)

Image understanding & OCR

Supports vision input - can analyze screenshots, diagrams, photos, and scanned documents directly

GPT-4o (2024-05-13)
Which Should You Choose?
Our recommendation:
GPT-4o (2024-05-13)

GPT-4o (2024-05-13) and Mistral Large 4 are extremely close in overall performance (only 0.8000000000000114 points apart). Your best choice depends entirely on which specific strengths matter most for your use case.

by OpenAI

  • Choose for Quality - Marginally better benchmark scores; both are excellent
  • Choose for Reliability - Higher uptime and faster response speeds
  • Choose for Prototyping - Stronger community support and better developer experience
  • Choose for Production - Wider enterprise adoption and proven at scale

by Mistral AI

  • Choose for Cost - 86% lower pricing; better value at scale
Capability Comparison
CapabilityGPT-4o (2024-05-13)Mistral Large 4
Vision (Image Input)
Function Calling
Streaming
JSON Mode
Reasoningdiffers
Web Search
Image Output
Monthly Cost Calculator
1,000tokens (600 in / 400 out)
100requests/day (3,000/month)

GPT-4o (2024-05-13)

OpenAI

$27.00
estimated monthly cost

Mistral Large 4

Mistral AI

Best Value
$3.78
estimated monthly cost

Mistral Large 4 saves you $23.22/month

That's 86% cheaper than GPT-4o (2024-05-13) at 1,000 tokens/request and 100 requests/day.

Assumes 60% input / 40% output token ratio per request. Actual costs may vary based on your usage pattern.

Parameters & Context
ParameterGPT-4o (2024-05-13)Mistral Large 4
Context Window128K1.0M
Max Output Tokens4,096262,144
Open SourceNoYes
CreatedMay 13, 2024Oct 6, 2026
Last updated: 35m ago

相关对比

GPT-4o (2024-05-13) vs Mistral Large 4 (2026) | LM Market Cap