---
title: "Deploy Bifrost"
description: "OpenAI-compatible AI gateway with failover, caching and a web UI"
category: "AI/ML"
url: https://railway.com/deploy/bifrost-4
---

# Deploy Bifrost

OpenAI-compatible AI gateway with failover, caching and a web UI

**[Deploy Bifrost on Railway](https://railway.com/template/bifrost-4)**

Machine-readable deploy manifest (JSON, validated by TemplateCI): https://railway.com/deploy/bifrost-4/manifest.json

- **Creator:** zer0person's Projects
- **Category:** AI/ML
- **Total deploys:** 1

## Template content

### Bifrost

- **Image:** maximhq/bifrost:latest
- **Health check:** /health
- **Public domain:** Yes

## Documentation

# Deploy and Host Bifrost on Railway

[Bifrost](https://github.com/maximhq/bifrost) is a high-performance AI gateway. It exposes one OpenAI-compatible API in front of 20+ providers (OpenAI, Anthropic, AWS Bedrock, Google Vertex, Groq, Ollama and more) and adds automatic failover, load balancing, semantic caching, virtual keys and budgets, with a web UI for configuration and analytics.

## About Hosting Bifrost

This template runs the official `maximhq/bifrost:latest` image on port 8080 with a persistent volume at `/app/data` for its config and log databases. The template generates a random `BIFROST_SETUP_TOKEN` and `BIFROST_ENCRYPTION_KEY` (both in the service Variables tab). Until the first admin account exists, every API call must carry the setup token, so a stranger cannot claim your gateway: open the URL, create your admin account (enter the setup token if the UI asks for it), then add your provider API keys in the UI. Provider keys are stored encrypted with the generated encryption key; do not change that variable afterwards.

Inference endpoints require authentication by default once the admin account exists; use a virtual key or the admin credentials for your clients.

## Common Use Cases

- One endpoint for several LLM providers with fallback between them
- Per-team virtual keys with budgets and rate limits
- Caching and observability in front of an existing OpenAI-style app

## Dependencies for Bifrost Hosting

- One service with a volume; the LLM provider API keys you add in the UI

### Deployment Dependencies

- [Bifrost on GitHub](https://github.com/maximhq/bifrost)
- [Documentation](https://docs.getbifrost.ai)
- [Docker image](https://hub.docker.com/r/maximhq/bifrost)

## Why Deploy Bifrost on Railway?

Railway gives you a public HTTPS URL, a persistent volume, generated secrets and automatic restarts with no server to maintain.


## Similar templates

- [Chat Chat](https://railway.com/deploy/-WWW5r) — Chat Chat, your own unified chat and search to AI platform.
- [Weaviate](https://railway.com/deploy/weaviate-1) — Vector database with hybrid search and an API key-protected API
- [Möbius v0.1 Personal AI OS](https://railway.com/deploy/mobius-v01-personal-ai-os) — Self-hosted AI agent that builds and runs apps for you, with memory.

Open this page in a browser: https://railway.com/deploy/bifrost-4