AI Gateway Directory

Datadog LLM Observability

LLM traces inside Datadog

Datadog's LLM Observability traces prompts, tool calls and agent steps, and ties them to the rest of an app's metrics and logs. It suits teams that already use Datadog for monitoring.

datadogapmtracingenterprise

More in Observability

Arize Phoenix

Observability

AI observability and evaluation you can self-host

Freephoenixarize

Braintrust

Observability

Evals, logging and prompt tooling for AI products

Freemiumbraintrustevals

Helicone

Observability

Open-source LLM observability through a proxy or SDK

Freemiumheliconelogging

Langfuse

Observability

Open-source LLM observability, evals and prompt management

Freemiumlangfusetracing

LangSmith

Observability

Tracing, evals and deployment from the LangChain team

Freemiumlangsmithlangchain

OpenLLMetry

Observability

OpenTelemetry instrumentation for LLM apps

Open sourceopentelemetrytraceloop