AI Gateway Directory

Braintrust

Evals, logging and prompt tooling for AI products

Braintrust combines evaluation, tracing and a prompt playground. Teams use it to score model outputs against datasets, compare changes and watch production traffic for regressions.

braintrustevalstracingprompts

More in Observability

Arize Phoenix

Observability

AI observability and evaluation you can self-host

Freephoenixarize

Datadog LLM Observability

Observability

LLM traces inside Datadog

Paiddatadogapm

Helicone

Observability

Open-source LLM observability through a proxy or SDK

Freemiumheliconelogging

Langfuse

Observability

Open-source LLM observability, evals and prompt management

Freemiumlangfusetracing

LangSmith

Observability

Tracing, evals and deployment from the LangChain team

Freemiumlangsmithlangchain

OpenLLMetry

Observability

OpenTelemetry instrumentation for LLM apps

Open sourceopentelemetrytraceloop