The most popular web UI for running local LLMs. Gradio-based interface for Llama, Mistral, and hundreds of GGUF models with a rich extensions ecosystem.
text-generation-webui is in a declining trend within Local AI — consider whether the team is still actively investing before building on it.