DirectoryModels › Phi-3.5 Mini

Phi-3.5 Mini

Models ✓ verified 🔒 local-only MIT
HuggingFace ↗ Ollama ↗

The Phi-3.5 Mini is a compact version of Microsoft's Phi-3.8B model, designed for reasoning tasks. It is a self-hostable AI tool that can be used locally. The model is tuned to operate efficiently in a small footprint.

Who it's for: This tool is suitable for users who require a compact and efficient reasoning model for their applications.

Run it locally

ollama run phi3.5

Strengths

  • It operates on a compact 3.8B model
  • Suitable for self-hosting
  • Tuned for reasoning tasks

Trade-offs

  • Limited availability of source code (GitHub repository not provided)
  • May have limitations in terms of its specific use cases or applications

Data locality

Runs fully offline — no data leaves your machine.

Hardware estimate

3.8B params · ~3.5 GB VRAM at Q4_K_M (estimate). Check your machine →