AI Gateway Directory
● 78 listings · updated 2026-11-11

AI gateways, LLM APIs and model providers.

Labs, inference platforms, gateways and observability for LLM apps.

78listings
7categories
29with public code

Anthropic API Featured

Claude models through the Anthropic developer platform

PaidFrontier labs

Google Gemini API Featured

Gemini models via Google AI Studio and the Gemini API

FreemiumFrontier labs

Llama Featured

Meta's open-weight model family

FreeOpen-weight providers

Ollama Featured

Run open models locally with one command

Open sourceInference platforms

OpenAI API Featured

GPT and reasoning models behind one developer API

PaidFrontier labs

OpenRouter Featured

One API and one bill for hundreds of models

FreemiumGateways & routers

Alibaba Cloud Model Studio

Qwen models and a model service on Alibaba Cloud

PaidFrontier labs

Amazon Bedrock

Managed access to many foundation models on AWS

PaidInference platforms

Amazon Nova

Amazon's own foundation models on Bedrock

PaidFrontier labs

Arize Phoenix

AI observability and evaluation you can self-host

FreeObservability

Axolotl

Config-driven fine-tuning for open LLMs

Open sourceFine-tuning

Azure AI Foundry

Microsoft's platform for building with models and agents

PaidInference platforms

Baseten

Production inference for open and custom models

PaidInference platforms

BGE (FlagEmbedding)

Open BGE embedding and reranker models

Open sourceEmbeddings & rerank

Bifrost

Fast open-source LLM gateway from Maxim

Open sourceGateways & routers

Braintrust

Evals, logging and prompt tooling for AI products

FreemiumObservability

Cerebras

Inference on wafer-scale chips

FreemiumInference platforms

Cloudflare AI Gateway

Proxy for AI traffic with caching and rate limits

FreemiumGateways & routers

Cloudflare Workers AI

Run models on Cloudflare's network

FreemiumInference platforms

Cohere

Enterprise language models for search and agents

FreemiumFrontier labs

Cohere Embed

Multilingual and multimodal embeddings

FreemiumEmbeddings & rerank

Cohere Rerank

Rerank search results with a hosted model

FreemiumEmbeddings & rerank

Datadog LLM Observability

LLM traces inside Datadog

PaidObservability

DeepInfra

Pay-per-token API for open models

PaidInference platforms

DeepSeek API

Low-cost reasoning and chat models, OpenAI-compatible

PaidFrontier labs

DeepSeek-V3

Open weights for DeepSeek's V3 mixture-of-experts model

Open sourceOpen-weight providers

Eden AI

European AI gateway with one API for many models

FreemiumGateways & routers

Fireworks AI

Fast inference for open and custom models

PaidInference platforms

Gemini embeddings

Embedding models in the Gemini API

FreemiumEmbeddings & rerank

Gemma

Google's lightweight open models

FreeOpen-weight providers

GLM-4.5

Z.ai's open GLM model series

Open sourceOpen-weight providers

Google Vertex AI

Google Cloud's platform for models and ML

PaidInference platforms

gpt-oss

OpenAI's open-weight reasoning models

Open sourceOpen-weight providers

Groq

Inference on custom LPU chips

FreemiumInference platforms

Helicone

Open-source LLM observability through a proxy or SDK

FreemiumObservability

Hugging Face Inference Providers

One API across many inference partners

FreemiumInference platforms

Hugging Face TRL

Train language models with SFT, DPO and RL

Open sourceFine-tuning

IBM Granite

IBM's open enterprise language models

Open sourceOpen-weight providers

Jina AI

Embeddings, rerankers and web reader APIs

FreemiumEmbeddings & rerank

Kimi K2

Moonshot AI's open mixture-of-experts model

Open sourceOpen-weight providers

Kong AI Gateway

AI traffic management on the Kong API gateway

FreemiumGateways & routers

Langfuse

Open-source LLM observability, evals and prompt management

FreemiumObservability

LangSmith

Tracing, evals and deployment from the LangChain team

FreemiumObservability

LiteLLM

Open-source proxy and SDK for 100+ LLM providers

Open sourceGateways & routers

LLaMA-Factory

Unified fine-tuning for 100+ language models

Open sourceFine-tuning

llama.cpp

C/C++ inference for GGUF models on everyday hardware

Open sourceInference platforms

Mistral AI

French lab with hosted APIs and open models

FreemiumFrontier labs

Mixedbread

Search, embedding and rerank models and APIs

FreemiumEmbeddings & rerank

Modal

Serverless GPUs defined in Python

FreemiumInference platforms

NVIDIA Nemotron

Open NVIDIA models with open data and recipes

FreeOpen-weight providers

OLMo

Fully open language models from Ai2

Open sourceOpen-weight providers

OpenAI embeddings

Text embedding models from OpenAI

PaidEmbeddings & rerank

OpenAI fine-tuning

Fine-tune OpenAI models on your own examples

PaidFine-tuning

OpenLLMetry

OpenTelemetry instrumentation for LLM apps

Open sourceObservability

Opik

Open-source LLM tracing and evals from Comet

FreemiumObservability

Oumi

Open platform to train, evaluate and deploy models

Open sourceFine-tuning

Perplexity API

Search-grounded answers and a web search API

PaidFrontier labs

Phi

Microsoft's small language models

Open sourceOpen-weight providers

Portkey

AI gateway with guardrails, caching and observability

FreemiumGateways & routers

PostHog LLM analytics

LLM traces next to product analytics

FreemiumObservability

Pydantic Logfire

OpenTelemetry observability from the Pydantic team

FreemiumObservability

Qwen3

Alibaba's open Qwen3 language models

Open sourceOpen-weight providers

Qwen3 Embedding

Open embedding and reranking models from the Qwen team

Open sourceEmbeddings & rerank

Replicate

Run models through an API without managing servers

PaidInference platforms

Requesty

LLM router with failover and governance

PaidGateways & routers

SambaNova

Inference cloud on custom RDUs

PaidInference platforms

Sentence Transformers

Python library for embedding and rerank models

Open sourceEmbeddings & rerank

TensorZero

Open-source LLM gateway, evals and optimization

Open sourceGateways & routers

Text Embeddings Inference

Hugging Face server for embedding and rerank models

Open sourceEmbeddings & rerank

Tinker

Fine-tuning API for open-weight models

PaidFine-tuning

Together AI

Serverless and dedicated inference for open models

PaidInference platforms

torchtune

PyTorch-native library for fine-tuning LLMs

Open sourceFine-tuning

Unsloth

Faster, lower-memory fine-tuning of open models

Open sourceFine-tuning

Vercel AI Gateway

One endpoint for models from many providers

FreemiumGateways & routers

vLLM

High-throughput open-source LLM serving engine

Open sourceInference platforms

Voyage AI

Embedding and reranking models for retrieval

FreemiumEmbeddings & rerank

Weights & Biases Weave

Tracing and evaluation for AI applications

FreemiumObservability

xAI API

Grok models for developers

PaidFrontier labs

Browse by category

All categories
Frontier labs10Open-weight providers11Inference platforms17Gateways & routers10Observability11Fine-tuning8Embeddings & rerank11