AI Gateway Directory

Langfuse

Open-source LLM observability, evals and prompt management

Langfuse records traces of LLM calls and agent runs, and adds evaluations, datasets and prompt versioning. It is built on OpenTelemetry and can be self-hosted or used as a cloud service.

langfusetracingevalsopentelemetry

More in Observability

Arize Phoenix

Observability

AI observability and evaluation you can self-host

Freephoenixarize

Braintrust

Observability

Evals, logging and prompt tooling for AI products

Freemiumbraintrustevals

Datadog LLM Observability

Observability

LLM traces inside Datadog

Paiddatadogapm

Helicone

Observability

Open-source LLM observability through a proxy or SDK

Freemiumheliconelogging

LangSmith

Observability

Tracing, evals and deployment from the LangChain team

Freemiumlangsmithlangchain

OpenLLMetry

Observability

OpenTelemetry instrumentation for LLM apps

Open sourceopentelemetrytraceloop