Portkey
AI gateway with guardrails, caching and observability
Portkey's gateway routes calls to many LLM providers with retries, fallbacks, caching and guardrails. The core gateway is open source, with a hosted control plane for logs and governance.
More in Gateways & routers
Featured
OpenRouter
Gateways & routers
One API and one bill for hundreds of models
Bifrost
Gateways & routers
Fast open-source LLM gateway from Maxim
Cloudflare AI Gateway
Gateways & routers
Proxy for AI traffic with caching and rate limits
Eden AI
Gateways & routers
European AI gateway with one API for many models
Kong AI Gateway
Gateways & routers
AI traffic management on the Kong API gateway
LiteLLM
Gateways & routers
Open-source proxy and SDK for 100+ LLM providers