Self-Hosted AI Models
153 open-source AI models you can run on your own infrastructure. Self-hosting gives you complete data privacy, zero per-token costs, and full control over the model and its behavior.
Top Open Source Providers
All Self-Hostable Models - Ranked by Score
| # | Model | Score |
|---|---|---|
| 1 | DeepSeek V4 ProDeepSeek | 87 |
| 2 | DeepSeek V3.2DeepSeek | 81 |
| 3 | Gemma 4 31BGoogle | 81 |
| 4 | Gemma 4 31B (free)Google | 81 |
| 5 | Qwen3.5 397B A17BAlibaba | 79 |
| 6 | R1 0528DeepSeek | 79 |
| 7 | GLM 5.2Zhipu AI | 79 |
| 8 | GLM 5.2 (batch)Zhipu AI | 78 |
| 9 | GLM 5.1Zhipu AI | 78 |
| 10 | MiniMax M2.7MiniMax | 78 |
| 11 | MiniMax M2.5MiniMax | 78 |
| 12 | GLM 5Zhipu AI | 78 |
| 13 | Qwen3.5-122B-A10BAlibaba | 78 |
| 14 | Gemma 2 27BGoogle | 77 |
| 15 | Qwen3.5-27BAlibaba | 77 |
| 16 | MiMo-V2.5-ProXiaomi | 76 |
| 17 | Qwen3.5-35B-A3BAlibaba | 76 |
| 18 | Kimi K2.6Moonshot AI | 76 |
| 19 | GLM 4.7Zhipu AI | 75 |
| 20 | GLM 4.6Zhipu AI | 75 |
| 21 | GLM 4.5Zhipu AI | 75 |
| 22 | MiniMax M3MiniMax | 74 |
| 23 | R1DeepSeek | 74 |
| 24 | MiniMax M3 (batch)MiniMax | 74 |
| 25 | Inklingthinkingmachines | 74 |
| 26 | Hy3Tencent | 74 |
| 27 | MiMo-V2.5Xiaomi | 73 |
| 28 | Gemma 4 26B A4B Google | 73 |
| 29 | Gemma 4 26B A4B (free)Google | 73 |
| 30 | Inkling (batch)thinkingmachines | 73 |
| 31 | MiniMax M2.1MiniMax | 72 |
| 32 | MiniMax M2MiniMax | 72 |
| 33 | DeepSeek V3.2 ExpDeepSeek | 72 |
| 34 | DeepSeek V3.1DeepSeek | 72 |
| 35 | DeepSeek V3 0324DeepSeek | 72 |
| 36 | Inkling Smallthinkingmachines | 72 |
| 37 | GLM 4.5 AirZhipu AI | 71 |
| 38 | DeepSeek V3DeepSeek | 70 |
| 39 | Qwen3 VL 235B A22B ThinkingAlibaba | 69 |
| 40 | Qwen3 VL 235B A22B InstructAlibaba | 69 |
Self-Hosting AI Models
Complete Data Privacy
Your data never leaves your infrastructure. Critical for healthcare, finance, legal, and government use cases where data residency and privacy regulations apply.
Zero Per-Token Cost
After the initial hardware investment, there are no per-request charges. At high volumes, self-hosting can be 10-100x cheaper than API-based services.
Popular Hosting Options
Run models with vLLM, Ollama, text-generation-inference, or llama.cpp. Most can run on consumer GPUs (RTX 4090) for smaller models, or cloud GPUs (A100, H100) for larger ones.
Fine-Tuning & Customization
Self-hosted models can be fine-tuned on your own data, creating domain-specific versions that outperform general-purpose models for your use case.
Self-hosting gives you complete data privacy (no data leaves your servers), eliminates per-token API costs, removes rate limits, enables offline operation, and allows fine-tuning for your specific use case.
Requirements depend on model size. Small models (7B parameters) run on consumer GPUs with 8GB VRAM. Medium models (13-30B) need 24GB+ VRAM. Large models (70B+) require multiple high-end GPUs or specialized inference hardware.
Popular tools include Ollama (easiest setup), llama.cpp (most efficient for CPU inference), vLLM (fastest for GPU serving), and text-generation-webui (feature-rich UI). Each excels at different use cases.
For high-volume usage (thousands of requests/day), self-hosting is significantly cheaper. For low-volume or sporadic use, API access is more cost-effective since you avoid hardware costs and maintenance overhead.