llms.py
llms.py
The self-hosted, OpenAI-compatible AI gateway for text, image & audio — a lightweight CLI, server and OSS Open WebUI alternative for Local and Cloud LLMs
View the DocsExplore the GalleryView on GitHub
July 20, 2026 \- v4 Released! →
530+
Models
24
Providers
3
Modalities · Text · Image · Audio
100%
Open Source & Self-Hosted
One tool, every modality
Generate Anything
From a single self-hosted gateway — chat with 530+ models, create images, and synthesize speech across 24 providers
Text & ChatA fast, private, ChatGPT-like web UI over every local & cloud LLM — with tools, MCP, skills, agents and 200+ system promptsImage GenerationCreate images via Gemini, OpenAI, OpenRouter, Chutes, Z.ai & Nvidia — right inside the chat and gallery workflowAudio & SpeechHigh-quality text-to-speech with Gemini & OpenRouter models, plus voice-to-text input via the microphone
Create → Publish → Showcase
Your Creations, in the Public Gallery
Anything you generate in llms.py can be published with one click — landing in the live showcase at ai.llmspy.org, browsable by everyone with categories, tags, ratings and infinite scroll.
- Browse generated images & audio by category and tag
- Play full Projects built by AI — games and apps, ready to run
- Free & anonymous publisher account — no email required
Explore the GalleryLearn more →
ImagesAudioProjects
Playable & self-contained
Projects Built by AI
Complete, self-contained apps & games — generated with llms.py and published for anyone to open and play
Space BlocksSpace themed Tetris with power ups
BreakoutStunning sci-fi breakout game
2048Neon 2048 Arcade game
Pac ManStunning Sci-Fi Pacman
AsteroidsThe classic Asteroids game
PongSci-Fi Neon Pong
Quick Install
`pip install llms-py`
💬 Simple Chat
Ask questions directly from the command line
terminal
Copy
$ llms "What is the capital of France?"
Paris is the capital of France. It's located in the north-central part of the country and is known for its art, fashion, gastronomy, and culture. The city is home to iconic landmarks like the Eiffel Tower, the Louvre Museum, and Notre-Dame Cathedral.
Run Server
`llms --serve 8000`
Beautiful Themes
Personalize your experience with a selection ofhandcrafted themes
Nord
NordMatrixBlue SmokeDark
Light SlateSoft PinkLight SkyLight
💬 ChatGPT-like Interface
Modern, fast, and privacy-focused web UI for all your local and remote LLMs
What's New
Latest release focused on extensibility, expanded provider support, and enhanced user experience
530+ Models from 24 ProvidersPowered by models.dev integration with automatic daily updatesExtensions SystemAdd features, providers, and customize the UI with flexible pluginsGemini File SearchRAG workflows with document stores, categories, and contextual chatCredentials AuthUsername/Password authentication with Admin UI and CLI user managementAgent ProfilesSpecialized AI agents with custom prompts, tools, themes, and Planner→Coder workflowsProjectsSecure workspace isolation that restricts AI agent filesystem access to designated project foldersTool SupportFirst-class Python function calling for LLM interactions with your environmentServer ToolsBuilt-in support for provider hosted Anthropic & OpenRouter server tools like web searchMCP SupportConnect to Model Context Protocol servers for extended tool capabilitiesSkills SupportExtend AI capabilities with specialized knowledge, workflows, and toolsAgent BrowserAI-powered browser automation with live preview, script editor, and element inspectorThemesCustomize the look and feel with built-in themes or create your ownCalculator & Run Code UIsBeautiful UIs to evaluate math and execute Python, JS, TS & C# codeMedia GalleryBrowse and manage all your generated images and audio in one placeVoice InputVoice-to-text transcription via microphone button or ALT+D keyboard shortcutImage GenerationBuilt-in support for Gemini, OpenAI, OpenRouter, Chutes, Z.ai and NvidiaAudio GenerationTTS support for Gemini 2.5 Flash/Pro Preview modelsKaTeX Math RenderingBeautiful LaTeX math typesetting for equations and formulas
Model Selector
Smart search, advanced filtering, sorting, and favorites over 530 models from 24 providers
Credentials Auth
Built-in Username/Password authentication with a Sign In page, Admin Web UI and CLI for user managing accounts, roles, and account locking
Agent Profiles & Projects
Configure specialized AI agents with custom prompts, tools, and themes — and scope their filesystem access to secure project workspaces
Gemini File Search & RAG
Build knowledge bases with document stores and contextual AI chat
Tools & Function Calling
First-class Python function calling for LLM interactions
Server Tools
Built-in support for provider-hosted OpenRouter & Anthropic server tools like web search, web fetch & code execution
MCP Support
Extend LLM capabilities with Model Context Protocol servers
Skills Support
Extend AI capabilities with specialized knowledge, workflows, and tools
Agent Browser
An integrated workspace for building and running automated browser scripts with AI assistance, live previews, and an interactive element inspector
Calculator UI
Beautiful interface for evaluating Python math expressions
Run Code UI
Execute Python, JavaScript, TypeScript, and C# code with syntax highlighting
PythonJavaScriptTypeScriptC#
KaTeX Math Typesetting
Beautiful rendering of LaTeX math expressions
Image & Audio Generation
Seamless media generation through UI and CLI
Image Generation →Audio Generation →
Media Gallery
Beautiful UI to browse all your generated images and audio
System Prompts Library
200+ curated system prompts for every use case
Runtime Provider Management
Enable or disable providers on the fly without configuration changes
Ready to Get Started?
Install llms.py and start chatting with 530+ AI models in minutes