Skip to content

Gemini 3.1 Pro Preview Custom Tools vs Phi 4

vs
Phi 4

Microsoft

60#208
Signal-by-Signal Comparison
SignalGemini 3.1 Pro Preview Custom ToolsDeltaPhi 4
Capabilities
100
+67
33
Benchmarks
92
+27
65
Pricing
88
-12
100
Context window size
96
+29
67
Recency
100
+72
28
Output Capacity
80
+10
70
Overall Result
5 wins
of 6
1 wins
Gemini 3.1 Pro Preview Custom Tools wins 5 of 6 signals

Score History

Score History (25 data points)
Gemini 3.1 Pro Preview Custom ToolsPhi 4
Gemini 3.1 Pro Preview Custom Tools

92.2

current score

Leader

Gemini 3.1 Pro Preview Custom Tools

right now

Phi 4

60.2

current score

LMMarketCap.com
Interactive Price Comparison
100Kcalls/month
1,000tokens (~1,333 chars)
500tokens (~667 chars)

Gemini 3.1 Pro Preview Custom Tools

Google

Per request$0.008000
Daily$26.67
Monthly$800.00
Annual$9600.00

Phi 4

Microsoft

Best Value
Per request$0.000140
Daily$0.47
Monthly$14.00
Annual$168.00

Phi 4 saves you $786.00/month

That's $9432.00/year compared to Gemini 3.1 Pro Preview Custom Tools at your current usage level of 100K calls/month.

98% cheaper
Choose Phi 4 for cost optimization

Gemini 3.1 Pro Preview Custom Tools pricing:
Input:$2.00/M tokens
Output:$12.00/M tokens
Phi 4 pricing:
Input:$0.07/M tokens
Output:$0.14/M tokens
Winner
Gemini 3.1 Pro Preview Custom Tools

Google

92

Composite Score

Phi 4

Microsoft

60

Composite Score

Signal-by-Signal Comparison
MetricGemini 3.1 Pro Preview Custom ToolsPhi 4Winner
Overall Score
92
60
Gemini 3.1 Pro Preview Custom Tools
Rank#15#208
Gemini 3.1 Pro Preview Custom Tools
Quality Rank#15#208
Gemini 3.1 Pro Preview Custom Tools
Adoption Rank#15#208
Gemini 3.1 Pro Preview Custom Tools
Parameters------
Context Window1049K16K
Gemini 3.1 Pro Preview Custom Tools
Pricing$2.00/$12.00/M$0.07/$0.14/M--
Signal Scores
Capabilities
100
33
Gemini 3.1 Pro Preview Custom Tools
Benchmarks
92
65
Gemini 3.1 Pro Preview Custom Tools
Pricing
88
100
Phi 4
Context window size
96
67
Gemini 3.1 Pro Preview Custom Tools
Recency
100
28
Gemini 3.1 Pro Preview Custom Tools
Output Capacity
80
70
Gemini 3.1 Pro Preview Custom Tools
Benchmark Head-to-Head(12 benchmarks)
Gemini 3.1: 4Phi 4: 0
Gemini 3.1
Phi 4
Normalized 0-100%
MMLU
92.6%84.8%
MMLU-Pro
91.2%70.5%
GPQA Diamond
94.3%56.1%
MATH-500
-80.4%
HumanEval
-82.6%
SWE-bench Verified
80.6%-
IFEval
-80.1%
BBH
-78%
ARC-Challenge
-95.5%
Arena Elo
14941256
LiveBench
-35.7%
BigCodeBench
-45.5%
Benchmark Interpretation

Our score (0-100) is driven by benchmark performance (90%) from Arena Elo ratings, MMLU, GPQA, HumanEval, SWE-bench, and 15+ standardized evaluations. Capabilities and context window serve as tiebreakers (10%). Learn more about our methodology.

Gemini 3.1 Pro Preview Custom ToolsElite Tier

Scores 92/100 (rank #15), placing it in the top 95% of all 290 models tracked.

Raw Quality0/100
Cost Efficiency0/100
Speed0/100
Phi 4Competitive

Scores 60/100 (rank #208), placing it in the top 29% of all 290 models tracked.

Raw Quality0/100
Cost Efficiency0/100
Speed0/100

Gemini 3.1 Pro Preview Custom Tools has a 32-point advantage, which typically translates to noticeably stronger performance on complex reasoning, code generation, and multi-step tasks.

When to Use Each Model

Choose Gemini 3.1 Pro Preview Custom Tools when you need:

  • Processing long documents or large codebases (1049K token context)
  • Multimodal workflows that require image understanding
  • Agentic applications using tool/function calling
  • Step-by-step reasoning and chain-of-thought problem solving

Choose Phi 4 when you need:

  • High-volume production workloads where API costs must be minimized
  • Self-hosted deployments where you need full control over the model
Cost-Performance Analysis
Gemini 3.1 Pro Preview Custom Tools
Input cost$2.00/M tokens
Output cost$12.00/M tokens
Cost per quality point$0.152
Est. monthly (1M tokens/day)$210.00
Phi 4Best Value
Input cost$0.07/M tokens
Output cost$0.14/M tokens
Cost per quality point$0.003
Est. monthly (1M tokens/day)$3.15

Phi 4 offers 99% better value per quality point. At 1M tokens/day, you'd spend $3.15/month with Phi 4 vs $210.00/month with Gemini 3.1 Pro Preview Custom Tools - a $206.85 monthly difference.

Latency & Speed
Gemini 3.1 Pro Preview Custom ToolsFaster
Speed score0/100
Phi 4
Speed score0/100

Both models have comparable response speeds. For most applications, the latency difference is negligible.

When latency matters most: Interactive chatbots, IDE code completion, real-time translation, and user-facing applications where response time directly impacts experience. For batch processing, background summarization, or offline analysis, latency is less critical.

Example Use Cases

Code generation & review

Based on overall model capabilities and architecture for coding tasks like generating functions, debugging, and refactoring

Gemini 3.1 Pro Preview Custom Tools

Customer support chatbot

Suitable for user-facing chat with competitive response times. Phi 4 also offers lower per-token costs for high-volume support

Gemini 3.1 Pro Preview Custom Tools

Long document analysis

Larger context window (1049K tokens) can process longer documents, contracts, and research papers in a single pass

Gemini 3.1 Pro Preview Custom Tools

Batch data extraction

Lower output pricing ($0.14/M) reduces costs when processing thousands of records daily

Phi 4

Creative writing & content

Higher overall composite score (92/100) correlates with better nuance, coherence, and style in long-form content

Gemini 3.1 Pro Preview Custom Tools

Image understanding & OCR

Supports vision input - can analyze screenshots, diagrams, photos, and scanned documents directly

Gemini 3.1 Pro Preview Custom Tools
Which Should You Choose?
Our recommendation:
Gemini 3.1 Pro Preview Custom Tools

Gemini 3.1 Pro Preview Custom Tools clearly outperforms Phi 4 with a significant 32-point lead. For most general use cases, Gemini 3.1 Pro Preview Custom Tools is the stronger choice. However, Phi 4 may still excel in niche scenarios.

by Google

  • Choose for Quality - Marginally better benchmark scores; both are excellent
  • Choose for Reliability - Higher uptime and faster response speeds
  • Choose for Prototyping - Stronger community support and better developer experience
  • Choose for Production - Wider enterprise adoption and proven at scale

by Microsoft

  • Choose for Cost - 99% lower pricing; better value at scale
Capability Comparison
CapabilityGemini 3.1 Pro Preview Custom ToolsPhi 4
Vision (Image Input)differs
Function Callingdiffers
Streaming
JSON Mode
Reasoningdiffers
Web Searchdiffers
Image Output
Monthly Cost Calculator
1,000tokens (600 in / 400 out)
100requests/day (3,000/month)

Gemini 3.1 Pro Preview Custom Tools

Google

$18.00
estimated monthly cost

Phi 4

Microsoft

Best Value
$0.2940
estimated monthly cost

Phi 4 saves you $17.71/month

That's 98% cheaper than Gemini 3.1 Pro Preview Custom Tools at 1,000 tokens/request and 100 requests/day.

Assumes 60% input / 40% output token ratio per request. Actual costs may vary based on your usage pattern.

Parameters & Context
ParameterGemini 3.1 Pro Preview Custom ToolsPhi 4
Context Window1.0M16K
Max Output Tokens65,53616,384
Open SourceNoYes
CreatedFeb 25, 2026Jan 10, 2025
Last updated: 23m ago

Related comparisons

Gemini 3.1 Pro Preview Custom Tools vs Phi 4 (2026) | LM Market Cap