
Portkey AI - Gateway
A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.
Gateway
portkeyai/gateway
Just deployed
One click Railway template for Portkey AI Gateway
- Features: https://portkey.ai/features/ai-gateway
- Repo: https://github.com/Portkey-AI/gateway
- Docker: https://hub.docker.com/r/portkeyai/gateway
What is Gateway?
Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency.
✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed)
✅ Load balance across multiple models, providers, and keys
✅ Fallbacks make sure your app stays resilient
✅ Automatic Retries with exponential fallbacks come by default
✅ Configurable Request Timeouts to easily handle unresponsive LLM requests
✅ Multimodal to support routing between Vision, TTS, STT, Image Gen, and more models
✅ Plug-in middleware as needed
✅ Battle tested over 300B tokens
✅ Enterprise-ready for enhanced security, scale, and custom deployments
Template Content
Gateway
portkeyai/gateway