Portkey AI - Gateway

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

Deploy Portkey AI - Gateway

Gateway

portkeyai/gateway

Just deployed

One click Railway template for Portkey AI Gateway

What is Gateway?

Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency.

✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed)

✅ Load balance across multiple models, providers, and keys

✅ Fallbacks make sure your app stays resilient

✅ Automatic Retries with exponential fallbacks come by default

✅ Configurable Request Timeouts to easily handle unresponsive LLM requests

✅ Multimodal to support routing between Vision, TTS, STT, Image Gen, and more models

✅ Plug-in middleware as needed

✅ Battle tested over 300B tokens

✅ Enterprise-ready for enhanced security, scale, and custom deployments


Template Content

More templates in this category

View Template

Chat Chat

Chat Chat, your own unified chat and search to AI platform.


View Template

openui

Deploy OpenUI: AI-powered UI generation with GitHub OAuth and OpenAI API.


View Template

firecrawl

firecrawl api server + worker without auth, works with dify