Small Language Models
90 lightweight AI models under $1/1M tokens. Small language models (SLMs) are optimized for speed, low cost, and edge deployment - ideal for mobile apps, IoT, chatbots, and high-volume production workloads.
Small Language Models - Ranked by Efficiency
| # | Model | Score |
|---|---|---|
| 1 | Jev Routertypesafe | 40 |
| 2 | SwitchyardNVIDIA | 40 |
| 3 | GPT-5.6 Luna Pro (batch)OpenAI | 89 |
| 4 | GPT-5.6 Luna (batch)OpenAI | 89 |
| 5 | DeepSeek V3.2DeepSeek | 83 |
| 6 | Gemma 4 31B (free)Google | 76 |
| 7 | Gemini 2.5 Flash LiteGoogle | 79 |
| 8 | GPT-5 Nano (batch)OpenAI | 77 |
| 9 | GPT-5.4 Nano (batch)OpenAI | 79 |
| 10 | GPT-5 NanoOpenAI | 77 |
| 11 | Gemma 4 31BGoogle | 76 |
| 12 | Gemma 2 27BGoogle | 77 |
| 13 | GLM 5.3 Flash (batch)Zhipu AI | 70 |
| 14 | DeepSeek V3.2 ExpDeepSeek | 72 |
| 15 | Claude Haiku 5.5Anthropic | 70 |
| 16 | GLM 5.3 FlashZhipu AI | 70 |
| 17 | Qwen3.5-9BAlibaba | 67 |
| 18 | GPT-4o-miniOpenAI | 69 |
| 19 | DeepSeek V3.1DeepSeek | 72 |
| 20 | DeepSeek V3DeepSeek | 70 |
| 21 | Phi 4Microsoft | 61 |
| 22 | GPT-4o-mini (batch)OpenAI | 63 |
| 23 | Llama 3.3 70B InstructMeta | 67 |
| 24 | Llama 4 ScoutMeta | 60 |
| 25 | GPT-4.1 Nano (batch)OpenAI | 59 |
| 26 | Qwen3 235B A22B Instruct 2507Alibaba | 65 |
| 27 | Llama 3.1 70B InstructMeta | 64 |
| 28 | Claude Haiku 5.5 (batch)Anthropic | 58 |
| 29 | MiniMax M2.7MiniMax | 64 |
| 30 | GLM 4.5 AirZhipu AI | 64 |
When to Use Small Language Models
High-Volume Applications
Processing millions of requests per day? SLMs cost 10-100x less than premium models. A chatbot handling 1M messages/month costs ~$100 with budget models vs $10,000+ with premium ones.
Edge & Mobile Deployment
Open-source SLMs can run on consumer hardware - laptops, phones, or edge devices. Models like Phi, Gemma, and small Llama variants fit in 4-8GB of RAM.
Low-Latency Requirements
Smaller models respond faster. For real-time applications like autocomplete, classification, or chat, SLMs deliver sub-100ms responses.
Task-Specific Workloads
Many tasks - classification, extraction, summarization, translation - don't need the largest models. A well-chosen SLM can match premium model quality on focused tasks.
Small language models are AI models with fewer parameters, typically under 10 billion. They run faster, cost less, and can operate on edge devices while still handling many common tasks like text generation, summarization, and simple coding assistance.
Use SLMs when you need low latency, low cost, or on-device deployment. Use full LLMs when you need complex reasoning, creative writing, or state-of-the-art accuracy. SLMs are ideal for chatbots, simple Q&A, and high-volume applications where cost matters more than peak performance.
SLMs trade some capability for speed and efficiency. Modern SLMs like Phi-3 and Gemma 2 can match older large models on many benchmarks. For specialized tasks, a fine-tuned SLM can outperform a general-purpose LLM while being 10-100x cheaper to run.