OpenLLMetry
OpenTelemetry instrumentation for LLM apps
OpenLLMetry from Traceloop is a set of open-source OpenTelemetry extensions for LLM libraries and vector databases. Traces can go to any backend that accepts OpenTelemetry data.
More in Observability
Arize Phoenix
Observability
AI observability and evaluation you can self-host
Braintrust
Observability
Evals, logging and prompt tooling for AI products
Datadog LLM Observability
Observability
LLM traces inside Datadog
Helicone
Observability
Open-source LLM observability through a proxy or SDK
Langfuse
Observability
Open-source LLM observability, evals and prompt management
LangSmith
Observability
Tracing, evals and deployment from the LangChain team