TensorZero
Open-source LLM gateway, evals and optimization
TensorZero is an open-source stack that combines an LLM gateway with observability, evaluation, optimization and experimentation, so inference data can feed back into prompts and models.
More in Gateways & routers
Featured
OpenRouter
Gateways & routers
One API and one bill for hundreds of models
Bifrost
Gateways & routers
Fast open-source LLM gateway from Maxim
Cloudflare AI Gateway
Gateways & routers
Proxy for AI traffic with caching and rate limits
Eden AI
Gateways & routers
European AI gateway with one API for many models
Kong AI Gateway
Gateways & routers
AI traffic management on the Kong API gateway
LiteLLM
Gateways & routers
Open-source proxy and SDK for 100+ LLM providers