Deploy LiteLLM Agent Control Plane
One control plane and UI for OpenCode, Hermes and Claude agents
LiteLLM Agent Control Plane
Just deployed
Just deployed
/var/lib/postgresql/data
Deploy and Host LiteLLM Agent Control Plane on Railway
LiteLLM Agent Control Plane (LAP) is one place to create, run and manage AI agents across runtimes such as Claude Managed Agents, OpenCode, Hermes, OpenClaw, Deep Agents and the Cursor Agents API. It gives your team a single web UI and API for agents, persistent sessions, cron schedules, memory, MCP tools and an Anthropic/OpenAI compatible LLM gateway.
About Hosting LiteLLM Agent Control Plane
This template runs the control plane itself (web UI + API) backed by Postgres:
- LiteLLM Agent Control Plane: built from the official repository's Dockerfile (Rust server + Next.js UI), listening on port 4000 behind a public HTTPS domain, health check on
/health. - Postgres: Railway's standard Postgres service with a persistent volume. It stores agents, sessions, schedules and the encrypted provider and runtime credentials.
- Generated secrets:
LITELLM_MASTER_KEY(admin login and API bearer key) andLITELLM_SALT_KEY(encrypts stored credentials). - Auth: every API route requires the master key (
Authorization: Bearerorx-api-key); the UI asks for it at sign-in.
After deploy:
- Open the service's Variables tab and copy
LITELLM_MASTER_KEY. - Open
https://YOUR-RAILWAY-DOMAINand sign in with that key. - Go to Settings and add your Anthropic API key (and any other providers). Runtimes such as Claude Agents read their credentials from Settings, not from environment variables.
- To use self-hosted runtimes (OpenCode, Hermes, Deep Agents, OpenClaw), deploy them separately from the repo's
templates/folder and register each one as a runtime in the UI (or withPOST /api/runtime-harnessesusing the master key).
Common Use Cases
- Give a team one UI to create, run and monitor agents without handing out Anthropic or Bedrock console access.
- Run agents on a cron schedule with persistent sessions and memory.
- Switch the same agent between runtimes (Claude Managed Agents, OpenCode, Hermes, Deep Agents).
- Use the built-in
/v1/messagesand/v1/responsesgateway for Claude Code, Codex and other tools behind one master key.
Dependencies for LiteLLM Agent Control Plane Hosting
- Source: LiteLLM-Labs/litellm-agent-control-plane (MIT), built from its root Dockerfile (no official prebuilt image is published).
- Postgres 16+.
- An Anthropic API key (
ANTHROPIC_API_KEY), entered at deploy time. OpenAI and other provider keys can be added later in Settings.
Deployment Dependencies
Implementation Details
- The gateway config lives in the
LAP_CONFIGvariable (single-line JSON, which is valid YAML). The start command writes it to a file at boot and runslite serve. The default has ananthropic/*wildcard route usingANTHROPIC_API_KEYplus agpt-5.5route whose key comes from Settings; editLAP_CONFIGto add models. Keys stored in Settings take precedence over the environment key. Everyos.environ/NAMEin the config must exist as a variable, or boot fails. LITELLM_SALT_KEYis generated separately from the master key, so you can rotateLITELLM_MASTER_KEYwithout losing the stored, encrypted provider credentials. Do not changeLITELLM_SALT_KEYafter first use.DATABASE_URLreferences the Postgres service over Railway's private network;LITELLM_PUBLIC_BASE_URLis set to the service's public domain so MCP proxy URLs point at the public address.- The first build compiles Rust from source and can take several minutes.
- The optional agent runtimes and the docker-compose
register-*sidecars are not included; register runtimes after deploy as described above.
Why Deploy LiteLLM Agent Control Plane on Railway?
Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you don't have to deal with configuration, while allowing you to vertically and horizontally scale it.
By deploying LiteLLM Agent Control Plane on Railway, you are one step closer to supporting a complete full-stack application with minimal burden. Host your servers, databases, AI agents, and more on Railway.
Template Content
LiteLLM Agent Control Plane
LiteLLM-Labs/litellm-agent-control-plane
