text-generation-webui logo

text-generation-webui

Feature-rich web UI for running large language models locally with multiple backends

41k Python AGPL-3.0 1 month ago

Overview

text-generation-webui by oobabooga is the most popular self-hosted frontend for running LLMs locally, supporting llama.cpp, ExLlamaV2, AutoGPTQ, transformers, and more. It offers a chat interface, instruction templates, character personas, and an OpenAI-compatible API. Extensions ecosystem allows adding capabilities like TTS, STT, and image generation.

Where it falls short of ChatGPT

  • No built-in team/multi-user auth; single-user by default
  • Model management UI is less polished than commercial offerings
  • No native document RAG pipeline (requires extensions)

We list the gaps honestly so you can decide if the trade-off is worth owning your data.

Tags

llm
inference
local-ai
chat
gradio
Maintain text-generation-webui?

Claim this listing to keep it accurate, add a deploy template, or feature it on relevant pages.

Show off your self-host difficulty score

Embed the text-generation-webui difficulty badge in your README — it links back here.

Self-host difficulty badge← add this to your README
[![Self-host difficulty](https://openreplace.com/api/badge/text-generation-webui)](https://openreplace.com/text-generation-webui)

Similar open-source projects

Other self-hostable tools in the same space worth comparing.

Run large language models locally with a simple CLI and REST API

175k Docker MIT 5 days ago
2/5
text-generation-webui vs Ollama

The most widely used web interface for running Stable Diffusion image generation locally

145k Python AGPL-3.0 1 month ago
2/5
text-generation-webui vs AUTOMATIC1111 Stable Diffusion WebUI

Feature-rich self-hosted chat UI for Ollama and OpenAI-compatible APIs

143k Docker BSD-3-Clause 8 days ago
2/5
text-generation-webui vs Open-WebUI

Modern AI chat framework with multi-provider support and MCP marketplace

79k Nodejs ⊘ Proprietary 5 days ago
3/5
text-generation-webui vs LobeHub