Directory › Models
Models
9 self-hostable models — verified and locality-checked.
Llama 3.2 3B
Small, fast Meta model good for on-device chat and lightweight tasks.
Llama 3.1 8B
Popular 8B general-purpose model; strong quality-to-size balance.
Qwen2.5 7B
Strong multilingual 7B model with a permissive license.
Qwen2.5-Coder 14B
Code-specialized 14B model competitive on programming benchmarks.
Gemma 2 9B
Google's efficient 9B open model, strong for its size.
Phi-3.5 Mini
Microsoft's compact 3.8B model tuned for reasoning in a small footprint.
Mistral 7B
Efficient, permissively-licensed 7B model widely used as a local baseline.
DeepSeek-R1 7B
Distilled reasoning model that exposes step-by-step thinking, runs locally.
Llama 3.3 70B
Large 70B model with near-frontier quality; needs a big GPU or lots of RAM.