Open WebUI: Deploy a ChatGPT-Like Interface for Your Local Models
Open WebUI gives you a full-featured, self-hosted chat interface with RAG, multi-user support, and image generation - running entirely on your infrastructure.
Open WebUI is a self-hosted web interface for local LLMs, designed as a feature-complete alternative to ChatGPT. It connects to Ollama (or any OpenAI-compatible endpoint) and adds a polished UI, document-based RAG, image generation, multi-user management, and a mobile-friendly PWA - all containerised and easy to deploy.
Open http://localhost:3000 and sign in with the admin account created on first launch. Open WebUI auto-discovers models from Ollama at host.docker.internal:11434.
Team workspace
Ship faster with chat, meetings, and projects in one place — Zlyqor.
From the admin panel you can pull, delete, and switch models without touching the terminal. Open WebUI shows model size, VRAM usage, and pull progress in real time.
RAG Pipeline
Upload PDFs, Word docs, or web URLs in any conversation. Open WebUI chunks the content, embeds it with a local embedding model (default: nomic-embed-text via Ollama), stores vectors in its built-in ChromaDB, and injects relevant chunks into the system prompt automatically. The docs cover configuring external vector databases and adjusting chunk size and overlap.
Image Generation via AUTOMATIC1111
Connect an AUTOMATIC1111 Stable Diffusion WebUI instance in Settings → Images to enable /imagine prompts inside chat conversations. The generated image appears inline in the message thread.
Multi-User With Roles
Open WebUI has a built-in user database with Admin, User, and Pending roles. Admins can control which models each user can access, set per-user API key auth, and view usage statistics. This makes it suitable for small-team internal deployments.
PWA on Mobile
Open WebUI ships as a Progressive Web App. Add it to your phone's home screen from Safari or Chrome for a native-app-like experience with persistent chat history and offline model caching.
API Key Authentication
For programmatic access, generate API keys from your profile settings. The API mirrors the OpenAI format - useful for connecting external tools to your self-hosted model stack without exposing Ollama directly.
Practical deep-dives on LLMs, developer tools, and AI engineering. No filler. Unsubscribe any time.
// written byFIG. AUTH-01
530
Mahmudul Haque Qudrati
CEO & ML Engineer
CEO and ML Engineer at Pristren. Builds AI-powered software for teams and writes about machine learning, LLMs, developer tools, and practical AI applications.
Open Code Review – An AI-powered code review CLI tool: A Practical Overview
Open Code Review is an open-source CLI tool from Alibaba that uses AI to review code changes. It runs locally, supports multiple LLMs, and costs about $0.01 per review. Here's a practical breakdown.