Deploy LiteLLM Agent Control Plane

One control plane and UI for OpenCode, Hermes and Claude agents

Deploy LiteLLM Agent Control Plane

LiteLLM Agent Control Plane

LiteLLM-Labs/litellm-agent-control-plane

Just deployed

/var/lib/postgresql/data

Deploy and Host LiteLLM Agent Control Plane on Railway

LiteLLM Agent Control Plane (LAP) is one place to create, run and manage AI agents across runtimes such as Claude Managed Agents, OpenCode, Hermes, OpenClaw, Deep Agents and the Cursor Agents API. It gives your team a single web UI and API for agents, persistent sessions, cron schedules, memory, MCP tools and an Anthropic/OpenAI compatible LLM gateway.

About Hosting LiteLLM Agent Control Plane

This template runs the control plane itself (web UI + API) backed by Postgres:

  • LiteLLM Agent Control Plane: built from the official repository's Dockerfile (Rust server + Next.js UI), listening on port 4000 behind a public HTTPS domain, health check on /health.
  • Postgres: Railway's standard Postgres service with a persistent volume. It stores agents, sessions, schedules and the encrypted provider and runtime credentials.
  • Generated secrets: LITELLM_MASTER_KEY (admin login and API bearer key) and LITELLM_SALT_KEY (encrypts stored credentials).
  • Auth: every API route requires the master key (Authorization: Bearer or x-api-key); the UI asks for it at sign-in.

After deploy:

  1. Open the service's Variables tab and copy LITELLM_MASTER_KEY.
  2. Open https://YOUR-RAILWAY-DOMAIN and sign in with that key.
  3. Go to Settings and add your Anthropic API key (and any other providers). Runtimes such as Claude Agents read their credentials from Settings, not from environment variables.
  4. To use self-hosted runtimes (OpenCode, Hermes, Deep Agents, OpenClaw), deploy them separately from the repo's templates/ folder and register each one as a runtime in the UI (or with POST /api/runtime-harnesses using the master key).

Common Use Cases

  • Give a team one UI to create, run and monitor agents without handing out Anthropic or Bedrock console access.
  • Run agents on a cron schedule with persistent sessions and memory.
  • Switch the same agent between runtimes (Claude Managed Agents, OpenCode, Hermes, Deep Agents).
  • Use the built-in /v1/messages and /v1/responses gateway for Claude Code, Codex and other tools behind one master key.

Dependencies for LiteLLM Agent Control Plane Hosting

  • Source: LiteLLM-Labs/litellm-agent-control-plane (MIT), built from its root Dockerfile (no official prebuilt image is published).
  • Postgres 16+.
  • An Anthropic API key (ANTHROPIC_API_KEY), entered at deploy time. OpenAI and other provider keys can be added later in Settings.

Deployment Dependencies

Implementation Details

  • The gateway config lives in the LAP_CONFIG variable (single-line JSON, which is valid YAML). The start command writes it to a file at boot and runs lite serve. The default has an anthropic/* wildcard route using ANTHROPIC_API_KEY plus a gpt-5.5 route whose key comes from Settings; edit LAP_CONFIG to add models. Keys stored in Settings take precedence over the environment key. Every os.environ/NAME in the config must exist as a variable, or boot fails.
  • LITELLM_SALT_KEY is generated separately from the master key, so you can rotate LITELLM_MASTER_KEY without losing the stored, encrypted provider credentials. Do not change LITELLM_SALT_KEY after first use.
  • DATABASE_URL references the Postgres service over Railway's private network; LITELLM_PUBLIC_BASE_URL is set to the service's public domain so MCP proxy URLs point at the public address.
  • The first build compiles Rust from source and can take several minutes.
  • The optional agent runtimes and the docker-compose register-* sidecars are not included; register runtimes after deploy as described above.

Why Deploy LiteLLM Agent Control Plane on Railway?

Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you don't have to deal with configuration, while allowing you to vertically and horizontally scale it.

By deploying LiteLLM Agent Control Plane on Railway, you are one step closer to supporting a complete full-stack application with minimal burden. Host your servers, databases, AI agents, and more on Railway.


Template Content

More templates in this category

View Template
Chat Chat
Chat Chat, your own unified chat and search to AI platform.

okisdev
117
View Template
Weaviate
Vector database with hybrid search and an API key-protected API

GitHub Locker
1
View Template
Möbius Personal AI OS
Self-hosted AI agent that builds and runs apps for you, with memory.

bento
1