Opik
Open-source LLM tracing and evals from Comet
Opik logs traces of LLM calls and RAG pipelines, runs automated evaluations and shows dashboards for production monitoring. Comet publishes the code and also runs a hosted version.
More in Observability
Arize Phoenix
Observability
AI observability and evaluation you can self-host
Braintrust
Observability
Evals, logging and prompt tooling for AI products
Datadog LLM Observability
Observability
LLM traces inside Datadog
Helicone
Observability
Open-source LLM observability through a proxy or SDK
Langfuse
Observability
Open-source LLM observability, evals and prompt management
LangSmith
Observability
Tracing, evals and deployment from the LangChain team