---
title: "Deploy LiteLLM (w/ Open WebUI)"
description: "LiteLLM gateway with Open WebUI team chat, one login and spend per person."
category: "AI/ML"
url: https://railway.com/deploy/litellm-w-open-webui
---

# Deploy LiteLLM (w/ Open WebUI)

LiteLLM gateway with Open WebUI team chat, one login and spend per person.

**[Deploy LiteLLM (w/ Open WebUI) on Railway](https://railway.com/template/litellm-w-open-webui)**

Machine-readable deploy manifest (JSON, validated by TemplateCI): https://railway.com/deploy/litellm-w-open-webui/manifest.json

- **Creator:** AvgSoft
- **Category:** AI/ML

## Template content

### LiteLLM https://cdn.jsdelivr.net/gh/mikedepo/railway-template-assets@0ecd7f580babe9d4cd72f46101518539d6eb3eca/service-icons/litellm.svg

- **Image:** ghcr.io/berriai/litellm:v1.106.6
- **Health check:** /health/readiness
- **Public domain:** Yes

### Setup https://cdn.jsdelivr.net/gh/mikedepo/railway-template-assets@0ecd7f580babe9d4cd72f46101518539d6eb3eca/service-icons/setup.svg

- **Image:** ghcr.io/railwayapp/function-bun:1.3.0
- **Start command:** `./run.sh Ly8gT25lLXRpbWUgc2V0dXAgZm9yIHRoZSAiTGl0ZUxMTSAody8gT3BlbiBXZWJVSSkiIHRlbXBsYXRlLCBydW4gYXMgYSBSYWlsd2F5IEZ1bmN0aW9uIChnaGNyLmlvL3JhaWx3YXlhcHAvZnVuY3Rpb24tYnVuKS4KLy8gUmVnaXN0ZXJzIHRoZSBrZXkgdGhlIHRlbXBsYXRlIGdlbmVyYXRlZCBmb3IgT3BlbiBXZWJVSSAoT1BFTl9XRUJVSV9LRVkpIGFzIGEgTGl0ZUxMTSB2aXJ0dWFsIGtleSBuYW1lZCAiT3BlbiBXZWJVSSIsCi8vIHNvIE9wZW4gV2ViVUkgY2FuIHVzZSBldmVyeSBtb2RlbCB5b3UgYWRkIGluIExpdGVMTE0gYW5kIGl0cyBzcGVuZCBzaG93cyBvbiBpdHMgb3duIGtleS4KLy8gU2FmZSB0byBydW4gYWdhaW46IGl0IGNoZWNrcyB3aGV0aGVyIHRoZSBrZXkgZXhpc3RzIGZpcnN0LgovLyBCdWlsZCB0aGUgdGVtcGxhdGUncyBzdGFydCBjb21tYW5kIGZyb20gdGhpcyBmaWxlOiAiLi9ydW4uc2ggIiArIGJhc2U2NChmaWxlKS4KLy8KLy8gVmFyaWFibGVzOiBMSVRFTExNX1VSTCwgTElURUxMTV9NQVNURVJfS0VZLCBPUEVOX1dFQlVJX0tFWS4KCmNvbnN0IExJVEVMTE0gPSAocHJvY2Vzcy5lbnYuTElURUxMTV9VUkwgPz8gJycpLnJlcGxhY2UoL1wvJC8sICcnKTsKY29uc3QgTUFTVEVSID0gcHJvY2Vzcy5lbnYuTElURUxMTV9NQVNURVJfS0VZID8/ICcnOwpjb25zdCBLRVkgPSBwcm9jZXNzLmVudi5PUEVOX1dFQlVJX0tFWSA/PyAnJzsKY29uc3QgQUxJQVMgPSAnT3BlbiBXZWJVSSc7Cgpjb25zdCBsb2cgPSAobXNnOiBzdHJpbmcpID0+IGNvbnNvbGUubG9nKGBbc2V0dXBdICR7bXNnfWApOwpjb25zdCBzbGVlcCA9IChtczogbnVtYmVyKSA9PiBuZXcgUHJvbWlzZSgocikgPT4gc2V0VGltZW91dChyLCBtcykpOwovLyBFeGl0IDAgb24gZmFpbHVyZSB0b28sIHNvIGEgc2V0dXAgcHJvYmxlbSBuZXZlciBtYXJrcyB0aGUgZGVwbG95IGFzIGZhaWxlZDsgdGhlIGxvZyBzYXlzIGhvdyB0byBmaW5pc2ggYnkgaGFuZC4KY29uc3Qgc3RvcCA9IChtc2c6IHN0cmluZyk6IG5ldmVyID0+IHsKICBsb2cobXNnKTsKICBsb2coYFRvIGZpbmlzaCBieSBoYW5kOiBzaWduIGluIHRvIExpdGVMTE0gYXQgJHtMSVRFTExNIHx8ICd5b3VyIExpdGVMTE0gVVJMJ30vdWksIGNyZWF0ZSBhIHZpcnR1YWwga2V5LCB0aGVuIHBhc3RlIGl0IGluIE9wZW4gV2ViVUkgdW5kZXIgQWRtaW4gUGFuZWwsIFNldHRpbmdzLCBDb25uZWN0aW9ucyAoT3BlbkFJIEFQSSkuYCk7CiAgcHJvY2Vzcy5leGl0KDApOwp9Owpjb25zdCBhcGkgPSAocGF0aDogc3RyaW5nLCBpbml0OiBSZXF1ZXN0SW5pdCA9IHt9KSA9PgogIGZldGNoKGAke0xJVEVMTE19JHtwYXRofWAsIHsgLi4uaW5pdCwgaGVhZGVyczogeyBhdXRob3JpemF0aW9uOiBgQmVhcmVyICR7TUFTVEVSfWAsICdjb250ZW50LXR5cGUnOiAnYXBwbGljYXRpb24vanNvbicsIC4uLihpbml0LmhlYWRlcnMgPz8ge30pIH0gfSk7CgppZiAoIUxJVEVMTE0gfHwgIU1BU1RFUiB8fCAhS0VZKSBzdG9wKCdtaXNzaW5nIExJVEVMTE1fVVJMLCBMSVRFTExNX01BU1RFUl9LRVkgb3IgT1BFTl9XRUJVSV9LRVknKTsKaWYgKCFLRVkuc3RhcnRzV2l0aCgnc2stJykgfHwgS0VZLmxlbmd0aCA8IDE2KSBzdG9wKCdPUEVOX1dFQlVJX0tFWSBtdXN0IHN0YXJ0IHdpdGggc2stIGFuZCBiZSBhdCBsZWFzdCAxNiBjaGFyYWN0ZXJzIChMaXRlTExNXCdzIHJ1bGUgZm9yIGNob3NlbiBrZXlzKScpOwoKLy8gMS4gV2FpdCBmb3IgTGl0ZUxMTSBhbmQgaXRzIGRhdGFiYXNlIChmaXJzdCBkZXBsb3lzIHJ1biBhbGwgbWlncmF0aW9ucyBmaXJzdCkuCmxldCByZWFkeSA9IGZhbHNlOwpmb3IgKGxldCBpID0gMDsgaSA8IDkwICYmICFyZWFkeTsgaSsrKSB7CiAgdHJ5IHsKICAgIGNvbnN0IHIgPSBhd2FpdCBmZXRjaChgJHtMSVRFTExNfS9oZWFsdGgvcmVhZGluZXNzYCk7CiAgICByZWFkeSA9IHIub2sgJiYgKGF3YWl0IHIuanNvbigpKT8uZGIgPT09ICdjb25uZWN0ZWQnOwogIH0gY2F0Y2gge30KICBpZiAoIXJlYWR5KSBhd2FpdCBzbGVlcCgxMF8wMDApOwp9CmlmICghcmVhZHkpIHN0b3AoYExpdGVMTE0gZGlkIG5vdCBiZWNvbWUgcmVhZHkgd2l0aGluIDE1IG1pbnV0ZXMgKCR7TElURUxMTX0vaGVhbHRoL3JlYWRpbmVzcylgKTsKbG9nKCdMaXRlTExNIGlzIHVwJyk7CgovLyAyLiBBbHJlYWR5IHJlZ2lzdGVyZWQ/IFRoZW4gd2UncmUgZG9uZS4KY29uc3QgaW5mbyA9IGF3YWl0IGFwaShgL2tleS9pbmZvP2tleT0ke2VuY29kZVVSSUNvbXBvbmVudChLRVkpfWApOwppZiAoaW5mby5zdGF0dXMgPT09IDQwMSB8fCBpbmZvLnN0YXR1cyA9PT0gNDAzKSBzdG9wKCdMaXRlTExNIHJlZnVzZWQgdGhlIG1hc3RlciBrZXkgKExJVEVMTE1fTUFTVEVSX0tFWSBjaGFuZ2VkPyknKTsKaWYgKGluZm8ub2spIHsKICBsb2coYHRoZSAiJHtBTElBU30iIGtleSBpcyBhbHJlYWR5IHJlZ2lzdGVyZWQ7IG5vdGhpbmcgdG8gZG9gKTsKICBwcm9jZXNzLmV4aXQoMCk7Cn0KCi8vIDMuIFJlZ2lzdGVyIGl0LiAiYWxsLXByb3h5LW1vZGVscyIgbWVhbnMgZXZlcnkgbW9kZWwgb24gdGhlIHByb3h5LCB0b2RheSBhbmQgYWZ0ZXIgTGl0ZUxMTSdzIHBsYW5uZWQgY2hhbmdlCi8vICAgIHRoYXQgbWFrZXMgYW4gZW1wdHkgbW9kZWwgbGlzdCBtZWFuIG5vbmUuCmNvbnN0IHJlcyA9IGF3YWl0IGFwaSgnL2tleS9nZW5lcmF0ZScsIHsKICBtZXRob2Q6ICdQT1NUJywKICBib2R5OiBKU09OLnN0cmluZ2lmeSh7IGtleTogS0VZLCBrZXlfYWxpYXM6IEFMSUFTLCBtb2RlbHM6IFsnYWxsLXByb3h5LW1vZGVscyddLCBtZXRhZGF0YTogeyBjcmVhdGVkX2J5OiAndGVtcGxhdGUgc2V0dXAnIH0gfSksCn0pOwppZiAoIXJlcy5vaykgc3RvcChgcmVnaXN0ZXJpbmcgdGhlICIke0FMSUFTfSIga2V5IGZhaWxlZCAoSFRUUCAke3Jlcy5zdGF0dXN9KTogJHsoYXdhaXQgcmVzLnRleHQoKSkuc2xpY2UoMCwgMzAwKX1gKTsKbG9nKGByZWdpc3RlcmVkIHRoZSAiJHtBTElBU30iIGtleSBpbiBMaXRlTExNOyBPcGVuIFdlYlVJIGNhbiBub3cgdXNlIGV2ZXJ5IG1vZGVsIHlvdSBhZGQgaW4gTGl0ZUxMTWApOwo=`

### Postgres https://cdn.jsdelivr.net/gh/mikedepo/railway-template-assets@6ab06146e7d9a658953ce107fdbb88d57799794d/service-icons/postgresql.svg

- **Image:** ghcr.io/railwayapp-templates/postgres-ssl:18

### Open WebUI https://cdn.jsdelivr.net/gh/open-webui/open-webui@v0.12.4/static/static/favicon.png

- **Image:** ghcr.io/open-webui/open-webui:0.12-slim
- **Health check:** /health
- **Public domain:** Yes

## Documentation

# Deploy and Host LiteLLM (w/ Open WebUI) on Railway

LiteLLM puts one OpenAI-compatible API in front of 100+ LLM providers; Open WebUI adds a ChatGPT-style chat for your team. Every chat goes through LiteLLM, so you see each person's spend.

![LiteLLM + Open WebUI: team chat on your own gateway, with spend per person](https://cdn.jsdelivr.net/gh/mikedepo/railway-template-assets@35c54aedbf87aaf87bf6ef47504e23ad6139a4ce/litellm-openwebui/banner.png)

## About Hosting LiteLLM (w/ Open WebUI)

1. Deploy with your email and a password. Setup connects Open WebUI to LiteLLM.
2. Sign in to LiteLLM at `/ui` with them and add a model with your provider key.
3. Sign in to Open WebUI and chat. Add your team in Admin Panel.

## Common Use Cases

- Private ChatGPT for your team
- Spend tracking per person
- One gateway for chat and apps

## Dependencies for LiteLLM (w/ Open WebUI) Hosting

- PostgreSQL
- Open WebUI

### Deployment Dependencies

- [LiteLLM proxy docs](https://docs.litellm.ai/docs/simple_proxy)
- [Open WebUI docs](https://docs.openwebui.com/)

### Implementation Details

![Architecture: Open WebUI sends each person's chats to LiteLLM; apps call LiteLLM directly; Postgres and Setup stay private](https://cdn.jsdelivr.net/gh/mikedepo/railway-template-assets@35c54aedbf87aaf87bf6ef47504e23ad6139a4ce/litellm-openwebui/architecture.png)

Needs about 1.2 GB (Trial or a paid plan). Attached documents go to the model in full. Back up Postgres and the Open WebUI volume; never change `LITELLM_SALT_KEY`. For a custom domain, add it to `CORS_ALLOW_ORIGIN`.

## Why Deploy LiteLLM (w/ Open WebUI) on Railway?


Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you don't have to deal with configuration, while allowing you to vertically and horizontally scale it.

By deploying LiteLLM (w/ Open WebUI) on Railway, you are one step closer to supporting a complete full-stack application with minimal burden. Host your servers, databases, AI agents, and more on Railway.


**Updated 2026-10-28:** first release, LiteLLM 1.106.6 and Open WebUI 0.12.


## Similar templates

- [Chat Chat](https://railway.com/deploy/-WWW5r) — Chat Chat, your own unified chat and search to AI platform.
- [Weaviate](https://railway.com/deploy/weaviate-1) — Vector database with hybrid search and an API key-protected API
- [Möbius v0.1 Personal AI OS](https://railway.com/deploy/mobius-v01-personal-ai-os) — Self-hosted AI agent that builds and runs apps for you, with memory.

Open this page in a browser: https://railway.com/deploy/litellm-w-open-webui