---
title: "Deploy openai-proxy"
description: "OpenAI Proxy (100+ LLMs) - OpenAI, Azure, Bedrock, Anthropic, HuggingFace"
category: "AI/ML"
url: https://railway.com/deploy/YTHiYS
---

# Deploy openai-proxy

OpenAI Proxy (100+ LLMs) - OpenAI, Azure, Bedrock, Anthropic, HuggingFace

**[Deploy openai-proxy on Railway](https://railway.com/template/YTHiYS)**

Machine-readable deploy manifest (JSON, validated by TemplateCI): https://railway.com/deploy/YTHiYS/manifest.json

- **Creator:** Ishaan Jaff's Projects
- **Category:** AI/ML
- **Total deploys:** 184

## Template content

### openai-proxy

- **Source:** https://github.com/BerriAI/litellm
- **Public domain:** Yes

## Documentation

A fast, and lightweight OpenAI-compatible server to call 100+ LLM APIs.

Call all LLM APIs using the OpenAI format. Use Azure, OpenAI, Cohere, Anthropic, Ollama, VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs)

Test your deployed proxy
import openai 
openai.api_base = "http://0.0.0.0:8000"

print(openai.ChatCompletion.create(model="test", messages=[{"role":"user", "content":"Hey!"}]))



## Similar templates

- [Chat Chat](https://railway.com/deploy/-WWW5r) — Chat Chat, your own unified chat and search to AI platform.
- [Weaviate](https://railway.com/deploy/weaviate-1) — Vector database with hybrid search and an API key-protected API
- [Möbius Personal AI OS](https://railway.com/deploy/mobius-v01-personal-ai-os) — Self-hosted AI agent that builds and runs apps for you, with memory.

Open this page in a browser: https://railway.com/deploy/YTHiYS
