Portkey AI - Gateway

Portkey AI - Gateway

A Blazing Fast AI Gateway. Route to 100+ LLMs with 1 fast & friendly API.

Deploy Portkey AI - Gateway

Gateway

portkeyai/gateway

Just deployed

One click Railway template for Portkey AI Gateway

What is Gateway?

Gateway streamlines requests to 100+ open & closed source models with a unified API. It is also production-ready with support for caching, fallbacks, retries, timeouts, loadbalancing, and can be edge-deployed for minimum latency.

✅ Blazing fast (9.9x faster) with a tiny footprint (~45kb installed)

✅ Load balance across multiple models, providers, and keys

✅ Fallbacks make sure your app stays resilient

✅ Automatic Retries with exponential fallbacks come by default

✅ Configurable Request Timeouts to easily handle unresponsive LLM requests

✅ Multimodal to support routing between Vision, TTS, STT, Image Gen, and more models

✅ Plug-in middleware as needed

✅ Battle tested over 300B tokens

✅ Enterprise-ready for enhanced security, scale, and custom deployments


Template Content

Deploy Now

Details

YAV.AI

Created on May 29, 2024

30 total projects

11 active projects

100% success on recent deploys

AI/ML



More templates in this category

View Template
Chat Chat

Chat Chat

Chat Chat, your own unified chat and search to AI platform.


okisdev

View Template
openui

openui

Deploy OpenUI: AI-powered UI generation with GitHub OAuth and OpenAI API.


zexd's Projects

View Template
firecrawl

firecrawl

firecrawl api server + worker without auth, works with dify


Rama