Self-Hosted AI Models
167 open-source AI models you can run on your own infrastructure. Self-hosting gives you complete data privacy, zero per-token costs, and full control over the model and its behavior.
Top Open Source Providers
All Self-Hostable Models - Ranked by Score
| # | Model | Score |
|---|---|---|
| 1 | DeepSeek V3.2DeepSeek | 83 |
| 2 | R1 0528DeepSeek | 79 |
| 3 | Gemma 2 27BGoogle | 77 |
| 4 | Gemma 4 31BGoogle | 76 |
| 5 | Gemma 4 31B (free)Google | 76 |
| 6 | DeepSeek V3.2 ExpDeepSeek | 72 |
| 7 | DeepSeek V3.1DeepSeek | 72 |
| 8 | DeepSeek V3 0324DeepSeek | 72 |
| 9 | Qwen3.5 397B A17BAlibaba | 71 |
| 10 | Llama 4 MaverickMeta | 70 |
| 11 | Qwen3.5-122B-A10BAlibaba | 70 |
| 12 | GLM 5.3 FlashZhipu AI | 70 |
| 13 | GLM 5.3 Flash (batch)Zhipu AI | 70 |
| 14 | DeepSeek V3DeepSeek | 70 |
| 15 | Qwen3.5-27BAlibaba | 69 |
| 16 | GLM 5.3Zhipu AI | 69 |
| 17 | GLM 5.3 (batch)Zhipu AI | 69 |
| 18 | GLM 5.2Zhipu AI | 69 |
| 19 | Qwen3.5-35B-A3BAlibaba | 69 |
| 20 | Mistral Large 4Mistral AI | 68 |
| 21 | GLM 5.1Zhipu AI | 68 |
| 22 | GLM 5Zhipu AI | 68 |
| 23 | GLM 4.5VZhipu AI | 68 |
| 24 | GLM 4.7Zhipu AI | 67 |
| 25 | GLM 4.6Zhipu AI | 67 |
| 26 | GLM 4.5Zhipu AI | 67 |
| 27 | Llama 3.3 70B InstructMeta | 67 |
| 28 | Qwen3.5-9BAlibaba | 67 |
| 29 | Qwen3 235B A22B Thinking 2507Alibaba | 65 |
| 30 | Qwen3 235B A22B Instruct 2507Alibaba | 65 |
| 31 | GLM 4.5 AirZhipu AI | 64 |
| 32 | MiniMax M2.7MiniMax | 64 |
| 33 | MiniMax M2.5MiniMax | 64 |
| 34 | Llama 3.1 70B InstructMeta | 64 |
| 35 | Mixtral 8x22B InstructMistral AI | 63 |
| 36 | Phi 4Microsoft | 61 |
| 37 | Llama 4 ScoutMeta | 60 |
| 38 | Command ACohere | 51 |
| 39 | Kimi K2.6Moonshot AI | 48 |
| 40 | Kimi K2.5Moonshot AI | 48 |
Self-Hosting AI Models
Complete Data Privacy
Your data never leaves your infrastructure. Critical for healthcare, finance, legal, and government use cases where data residency and privacy regulations apply.
Zero Per-Token Cost
After the initial hardware investment, there are no per-request charges. At high volumes, self-hosting can be 10-100x cheaper than API-based services.
Popular Hosting Options
Run models with vLLM, Ollama, text-generation-inference, or llama.cpp. Most can run on consumer GPUs (RTX 4090) for smaller models, or cloud GPUs (A100, H100) for larger ones.
Fine-Tuning & Customization
Self-hosted models can be fine-tuned on your own data, creating domain-specific versions that outperform general-purpose models for your use case.
Self-hosting gives you complete data privacy (no data leaves your servers), eliminates per-token API costs, removes rate limits, enables offline operation, and allows fine-tuning for your specific use case.
Requirements depend on model size. Small models (7B parameters) run on consumer GPUs with 8GB VRAM. Medium models (13-30B) need 24GB+ VRAM. Large models (70B+) require multiple high-end GPUs or specialized inference hardware.
Popular tools include Ollama (easiest setup), llama.cpp (most efficient for CPU inference), vLLM (fastest for GPU serving), and text-generation-webui (feature-rich UI). Each excels at different use cases.
For high-volume usage (thousands of requests/day), self-hosting is significantly cheaper. For low-volume or sporadic use, API access is more cost-effective since you avoid hardware costs and maintenance overhead.