AI Gateway Directory

Arize Phoenix

AI observability and evaluation you can self-host

Phoenix is a free tool you can self-host for tracing and evaluating LLM apps and agents. It accepts OpenTelemetry data and runs in a notebook, in a container or on Arize's hosted service.

phoenixarizetracingevals

More in Observability

Braintrust

Observability

Evals, logging and prompt tooling for AI products

Freemiumbraintrustevals

Datadog LLM Observability

Observability

LLM traces inside Datadog

Paiddatadogapm

Helicone

Observability

Open-source LLM observability through a proxy or SDK

Freemiumheliconelogging

Langfuse

Observability

Open-source LLM observability, evals and prompt management

Freemiumlangfusetracing

LangSmith

Observability

Tracing, evals and deployment from the LangChain team

Freemiumlangsmithlangchain

OpenLLMetry

Observability

OpenTelemetry instrumentation for LLM apps

Open sourceopentelemetrytraceloop