Top picks for Self-Hosted / Local (2026)
Open-weights models you can run yourself. Ranked from 452 live models on the OpenRouter catalog, weighted for low cost.
Updated 2026-10-13 · prices checked at this morning's rebuild
Which should you use? inclusionAI: Ling 3.0 Flash VL tops this ranking on blended score. To prototype without spending, NVIDIA: Nemotron 3 Nano Omni (free) is the best free option ranked here.
| # | Model | Score | In / 1M | Out / 1M | Context | |
|---|---|---|---|---|---|---|
| 1 | inclusionAI: Ling 3.0 Flash VLinclusionai/ling-3.0-flash-vl | 118 | $0.02 | $0.06 | 262,144 | Details → |
| 2 | Qwen: Qwen3.7 Flashqwen/qwen3.7-flash | 118 | $0.03 | $0.13 | 1,000,000 | Details → |
| 3 | inclusionAI: Ling 3.0 Flashinclusionai/ling-3.0-flash | 118 | $0.02 | $0.06 | 262,144 | Details → |
| 4 | NVIDIA: Nemotron 3 Nano Omni (free)nvidia/nemotron-3-nano-omni-30b-a3b-reasoning:free | 118 | Free | Free | 256,000 | Details → |
| 5 | Google: Gemma 4 26B A4B (free)google/gemma-4-26b-a4b-it:free | 118 | Free | Free | 262,144 | Details → |
| 6 | Google: Gemma 4 31B (free)google/gemma-4-31b-it:free | 118 | Free | Free | 262,144 | Details → |
| 7 | Anthropic: Claude Haiku 5.5 (batch)anthropic/claude-haiku-5.5:batch | 117 | $0.05 | $0.25 | 1,000,000 | Details → |
| 8 | OpenAI: GPT-6 Luna Pro (batch)openai/gpt-6-luna-pro:batch | 117 | $0.05 | $0.25 | 1,050,000 | Details → |
| 9 | OpenAI: GPT-6 Luna (batch)openai/gpt-6-luna:batch | 117 | $0.05 | $0.25 | 1,050,000 | Details → |
| 10 | Xiaomi: MiMo-V2.6-Flashxiaomi/mimo-v2.6-flash | 117 | $0.14 | $0.28 | 1,050,000 | Details → |
| 11 | DeepSeek: DeepSeek V4.1 Flash (batch)deepseek/deepseek-v4.1-flash:batch | 117 | $0.11 | $0.34 | 1,048,576 | Details → |
| 12 | Nex AGI: Nex-N2.5-Pronex-agi/nex-n2.5-pro | 117 | $0.07 | $0.25 | 262,144 | Details → |
| 13 | Meta: Muse Spark 1.3 Contributormeta/muse-spark-1.3-contributor | 117 | $0.10 | $0.20 | 1,048,576 | Details → |
| 14 | Z.ai: GLM 5.3 Flash (batch)z-ai/glm-5.3-flash:batch | 117 | $0.06 | $0.20 | 1,048,576 | Details → |
| 15 | Meta: Muse Spark 1.2 Contributormeta/muse-spark-1.2-contributor | 117 | $0.10 | $0.20 | 1,048,576 | Details → |
How we ranked these
For Self-Hosted / Local, we weight models on low cost. Scores combine each model's public specs with independent benchmark results (Aider Polyglot coding scores, Artificial Analysis intelligence/coding/agentic indices) and live pricing. See full methodology →
About Self-Hosted / Local
Self-hosted / local deployment means running open-weights AI models on your own hardware without relying on cloud APIs. You need this when you require privacy, want to avoid per-token costs at scale, need offline capability, or operate in restricted network environments. A good model for local deployment balances inference speed and output quality within your hardware constraints-typically measured in tokens per second and VRAM requirements. Quantization (reducing model precision to 4-bit or 8-bit) is the single most important cost lever: it cuts memory usage by 60-75% with minimal quality loss, often making the difference between running a model and not running it at all.
When to use: Use this when you want to run an AI model on your own computer or server without sending data to external cloud services, either to keep information private, save money on API fees, or work without an internet connection.
Common questions
What is the smallest model I can realistically run on a laptop?
Mistral 7B or Llama 2 7B quantized to 4-bit will run on most laptops with 8GB RAM using tools like Ollama or LM Studio, though you'll see noticeable slowdown compared to a GPU. For faster inference, aim for at least a GPU with 6-8GB of dedicated VRAM, which lets you run 13B models at practical speeds.
How much does it cost to run a model locally versus using an API?
Local deployment has near-zero marginal cost per inference after the initial hardware investment, while APIs typically cost $0.001-$0.10 per thousand tokens depending on model size. If you're running thousands of inferences monthly, self-hosting breaks even within weeks; if you're running millions monthly, it's orders of magnitude cheaper.