Directory › Inference runtimes › KoboldCpp

KoboldCpp

Inference runtimes ✓ verified 🔒 local-only AGPL-3.0 ★ 11,006
GitHub ↗ Website ↗

KoboldCpp is a single-file, llama.cpp-based runner with a UI for local text and story generation. It is a self-hostable AI tool. The tool is open-sourced under the AGPL-3.0 license.

Who it's for: Users who want to generate text locally should consider using KoboldCpp.

Strengths

  • KoboldCpp is a single-file runner
  • It has a UI for local text and story generation
  • The tool is open-sourced

Trade-offs

  • Limited functionality compared to other AI tools
  • May not be suitable for large-scale applications

Data locality

Runs fully offline — no data leaves your machine.