---
title: "Deploy OpenLIT"
description: "OpenTelemetry LLM observability: OpenLIT, ClickHouse, NATS, secure gateway"
category: "Observability"
url: https://railway.com/deploy/openlit
---

# Deploy OpenLIT

OpenTelemetry LLM observability: OpenLIT, ClickHouse, NATS, secure gateway

**[Deploy OpenLIT on Railway](https://railway.com/template/openlit)**

Machine-readable deploy manifest (JSON, validated by TemplateCI): https://railway.com/deploy/openlit/manifest.json

- **Creator:** Agaz Self-Host
- **Category:** Observability

## Template content

### ClickHouse https://cdn.jsdelivr.net/gh/homarr-labs/dashboard-icons/png/clickhouse.png

- **Source:** https://github.com/aalfath/openlit-railway-template
- **Health check:** /ping

### Gateway https://cdn.jsdelivr.net/gh/homarr-labs/dashboard-icons/png/caddy.png

- **Source:** https://github.com/aalfath/openlit-railway-template
- **Health check:** /healthz
- **Public domain:** Yes

### NATS https://raw.githubusercontent.com/nats-io/nats-site/3199d1df9b5a43898cf98aea2401b2fac33560e2/static/img/nats-icon-color.png

- **Source:** https://github.com/aalfath/openlit-railway-template
- **Health check:** /healthz

### OpenLIT https://raw.githubusercontent.com/openlit/openlit/openlit-2.1.1/src/client/public/images/logo.png

- **Source:** https://github.com/aalfath/openlit-railway-template
- **Health check:** /login

## Documentation

# Deploy and Host OpenLIT on Railway

OpenLIT is an open-source, OpenTelemetry-native observability platform for generative AI. It collects traces, metrics and costs from LLM calls, AI agents, vector databases and GPUs, and adds a prompt hub, a secrets vault, evaluations, realtime rules and an LLM playground. Apps send data with the OpenLIT SDKs or any OpenTelemetry exporter.

## About Hosting OpenLIT

This template runs OpenLIT 2.1.1 as four Railway services built from one public GitHub repo, each pinned by version and digest. **Gateway** (Caddy) is the only public URL: it serves the UI and takes OTLP/HTTP data on `/v1/traces`, `/v1/metrics` and `/v1/logs`. **OpenLIT** runs the web UI, the OTLP receiver and the realtime engine, with users and settings in SQLite on a volume. **ClickHouse** stores telemetry on its own volume. **NATS** (JetStream, on a volume) carries realtime signals. All passwords are generated per deploy, self sign-up is closed, and OTLP ingest needs an OpenLIT API key.

## Common Use Cases

* Trace LLM and agent calls (OpenAI, Anthropic, LangChain, LlamaIndex, CrewAI and more) with tokens, latency and cost per request
* Manage prompts and API secrets centrally, and run evaluations and guardrails on model output
* Watch GPU and vector-database usage next to your application traces, with realtime alert rules

## Dependencies for OpenLIT Hosting

* ClickHouse (included, on a Railway volume)
* NATS with JetStream (included, on a Railway volume)

### Deployment Dependencies

* OpenLIT source and docs: https://github.com/openlit/openlit and https://docs.openlit.io
* Release used: https://github.com/openlit/openlit/releases/tag/openlit-2.1.1
* Template repo (Dockerfiles, start scripts, changelog): https://github.com/aalfath/openlit-railway-template

### Implementation Details

After the deploy finishes, open the Gateway's URL and sign in as `user@openlit.io` with the password in the OpenLIT service's `OPENLIT_ADMIN_PASSWORD` variable. Create an API key in Settings → API Keys, then point your app at the Gateway:

```sh
export OTEL_EXPORTER_OTLP_ENDPOINT="https://YOUR-GATEWAY-DOMAIN"
export OTEL_EXPORTER_OTLP_HEADERS="Authorization=Bearer YOUR-OPENLIT-API-KEY"
```

Services in the same Railway project can send to `http://openlit.railway.internal:4318` (HTTP) or port 4317 (gRPC) with the same key. Optional settings: `ALLOW_SIGNUP=true` on Gateway opens self sign-up (for adding teammates), and `GOOGLE_CLIENT_ID`/`GOOGLE_CLIENT_SECRET` or `GITHUB_CLIENT_ID`/`GITHUB_CLIENT_SECRET` on OpenLIT enable OAuth sign-in. Updates: when the repo's pinned versions are bumped, Railway shows an update notice on your project; read the repo's CHANGELOG.md, then apply it. Volumes are kept, and OpenLIT runs its own migrations on start.

## Why Deploy OpenLIT on Railway?


Railway is a singular platform to deploy your infrastructure stack. Railway will host your infrastructure so you don't have to deal with configuration, while allowing you to vertically and horizontally scale it.

By deploying OpenLIT on Railway, you are one step closer to supporting a complete full-stack application with minimal burden. Host your servers, databases, AI agents, and more on Railway.



## Similar templates

- [Rootprint](https://railway.com/deploy/rootprint-1) — Open-source logs and traces with full-text search on object-storage.
- [Pyroscope profiling](https://railway.com/deploy/pyroscope-profiling) — Protected continuous profiling with durable Pyroscope storage.
- [SigOnly](https://railway.com/deploy/sigonly) — Deploy SigNoz with a working demo app & config in one click

Open this page in a browser: https://railway.com/deploy/openlit
