All Templates / AI/ML
Portkey AI - Gateway
A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.
Gateway
portkeyai/gateway
Just deployed
One click Railway template for Portkey AI Gateway
What is Gateway?
Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency.
✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed)
✅ Load balance across multiple models, providers, and keys
✅ Fallbacks make sure your app stays resilient
✅ Automatic Retries with exponential fallbacks come by default
✅ Configurable Request Timeouts to easily handle unresponsive LLM requests
✅ Multimodal to support routing between Vision, TTS, STT, Image Gen, and more models
✅ Plug-in middleware as needed
✅ Battle tested over 300B tokens
✅ Enterprise-ready for enhanced security, scale, and custom deployments
Template Content
Gateway
portkeyai/gatewayDetails
YAV.AI
Created on May 29, 2024
30 total projects
11 active projects
100% success on recent deploys
AI/ML
More templates in this category
openui
Deploy OpenUI: AI-powered UI generation with GitHub OAuth and OpenAI API.
zexd's Projects