Directory › Inference runtimes › Text Generation WebUI

Text Generation WebUI

Inference runtimes ✓ verified 🔒 local-only AGPL-3.0 ★ 47,443
GitHub ↗

The Text Generation WebUI is a Gradio web interface for running and interacting with local Large Language Models (LLMs) across various backends. It allows users to chat with LLMs without relying on cloud services. The tool is open-sourced under the AGPL-3.0 license.

Who it's for: This tool is suitable for users who want to run and interact with local LLMs, such as developers and researchers working with self-hostable AI solutions.

Strengths

  • Runs on-premises without relying on cloud services
  • Supports multiple backends for LLM deployment
  • Open-sourced under the AGPL-3.0 license

Trade-offs

  • Limited to local-only data storage
  • No information available on its performance or scalability

Data locality

Runs fully offline — no data leaves your machine.