Self-Hosted AI Models
177 open-source AI models you can run on your own infrastructure. Self-hosting gives you complete data privacy, zero per-token costs, and full control over the model and its behavior.
Top Open Source Providers
All Self-Hostable Models - Ranked by Score
| # | Model | Score |
|---|---|---|
| 1 | DeepSeek V3.2DeepSeek | 83 |
| 2 | Gemma 4 31BGoogle | 81 |
| 3 | Gemma 4 31B (free)Google | 81 |
| 4 | Qwen3.5 397B A17BAlibaba | 79 |
| 5 | R1 0528DeepSeek | 79 |
| 6 | GLM 5.3Zhipu AI | 79 |
| 7 | GLM 5.3 (batch)Zhipu AI | 79 |
| 8 | GLM 5.2Zhipu AI | 79 |
| 9 | GLM 5.3 FlashZhipu AI | 78 |
| 10 | GLM 5.1Zhipu AI | 78 |
| 11 | GLM 5Zhipu AI | 78 |
| 12 | GLM 5.3 Flash (batch)Zhipu AI | 78 |
| 13 | Qwen3.5-122B-A10BAlibaba | 78 |
| 14 | Gemma 2 27BGoogle | 77 |
| 15 | Qwen3.5-27BAlibaba | 77 |
| 16 | MiMo-V2.6-ProXiaomi | 76 |
| 17 | MiMo-V2.5-ProXiaomi | 76 |
| 18 | Qwen3.5-35B-A3BAlibaba | 76 |
| 19 | GLM 5.2 (free)Zhipu AI | 76 |
| 20 | Kimi K2.6Moonshot AI | 76 |
| 21 | GLM 4.7Zhipu AI | 75 |
| 22 | GLM 4.6Zhipu AI | 75 |
| 23 | GLM 4.5Zhipu AI | 75 |
| 24 | Hy3Tencent | 74 |
| 25 | MiniMax M3MiniMax | 74 |
| 26 | R1DeepSeek | 74 |
| 27 | Qwen3.8 27BAlibaba | 73 |
| 28 | MiMo-V2.5Xiaomi | 73 |
| 29 | Gemma 4 26B A4B Google | 73 |
| 30 | Gemma 4 26B A4B (free)Google | 73 |
| 31 | Qwen3.8 27B (free)Alibaba | 73 |
| 32 | Inklingthinkingmachines | 73 |
| 33 | Inkling (free)thinkingmachines | 73 |
| 34 | DeepSeek V3.2 ExpDeepSeek | 72 |
| 35 | DeepSeek V3.1DeepSeek | 72 |
| 36 | DeepSeek V3 0324DeepSeek | 72 |
| 37 | MiniMax M2.7MiniMax | 72 |
| 38 | MiniMax M2.5MiniMax | 72 |
| 39 | MiniMax M2.1MiniMax | 71 |
| 40 | MiniMax M2MiniMax | 71 |
Self-Hosting AI Models
Complete Data Privacy
Your data never leaves your infrastructure. Critical for healthcare, finance, legal, and government use cases where data residency and privacy regulations apply.
Zero Per-Token Cost
After the initial hardware investment, there are no per-request charges. At high volumes, self-hosting can be 10-100x cheaper than API-based services.
Popular Hosting Options
Run models with vLLM, Ollama, text-generation-inference, or llama.cpp. Most can run on consumer GPUs (RTX 4090) for smaller models, or cloud GPUs (A100, H100) for larger ones.
Fine-Tuning & Customization
Self-hosted models can be fine-tuned on your own data, creating domain-specific versions that outperform general-purpose models for your use case.
Self-hosting gives you complete data privacy (no data leaves your servers), eliminates per-token API costs, removes rate limits, enables offline operation, and allows fine-tuning for your specific use case.
Requirements depend on model size. Small models (7B parameters) run on consumer GPUs with 8GB VRAM. Medium models (13-30B) need 24GB+ VRAM. Large models (70B+) require multiple high-end GPUs or specialized inference hardware.
Popular tools include Ollama (easiest setup), llama.cpp (most efficient for CPU inference), vLLM (fastest for GPU serving), and text-generation-webui (feature-rich UI). Each excels at different use cases.
For high-volume usage (thousands of requests/day), self-hosting is significantly cheaper. For low-volume or sporadic use, API access is more cost-effective since you avoid hardware costs and maintenance overhead.