AI Gateway Directory

LangSmith

Tracing, evals and deployment from the LangChain team

LangSmith traces and debugs LLM applications, runs evaluations on datasets and monitors production. It works with LangChain and LangGraph, and also with any other framework through an SDK.

langsmithlangchaintracingevals

More in Observability

Arize Phoenix

Observability

AI observability and evaluation you can self-host

Freephoenixarize

Braintrust

Observability

Evals, logging and prompt tooling for AI products

Freemiumbraintrustevals

Datadog LLM Observability

Observability

LLM traces inside Datadog

Paiddatadogapm

Helicone

Observability

Open-source LLM observability through a proxy or SDK

Freemiumheliconelogging

Langfuse

Observability

Open-source LLM observability, evals and prompt management

Freemiumlangfusetracing

OpenLLMetry

Observability

OpenTelemetry instrumentation for LLM apps

Open sourceopentelemetrytraceloop