LiteLLM
Open-source proxy and SDK for 100+ LLM providers
LiteLLM translates one OpenAI-style call into the format of many providers. The proxy server adds virtual keys, budgets, rate limits and logging, and you can self-host it.
More in Gateways & routers
Featured
OpenRouter
Gateways & routers
One API and one bill for hundreds of models
Bifrost
Gateways & routers
Fast open-source LLM gateway from Maxim
Cloudflare AI Gateway
Gateways & routers
Proxy for AI traffic with caching and rate limits
Eden AI
Gateways & routers
European AI gateway with one API for many models
Kong AI Gateway
Gateways & routers
AI traffic management on the Kong API gateway
Portkey
Gateways & routers
AI gateway with guardrails, caching and observability