MLflow Tracing
Observability
Open-source LLM and agent tracing inside MLflow: one-line autolog, OpenTelemetry ingest, LLM judges. Free to self-host under Apache 2.0.
Observability
Loading tools…
HoneyHive
Observability
LLM and agent observability with OpenTelemetry tracing, online evals, CI regression gates, alerts and annotation queues.
Agenta
Observability
Open-source LLMOps and agent workspace: prompt versioning, 15+ evaluators and OpenTelemetry tracing, MIT-licensed and self-hostable.
Datadog LLM Observability
Observability
Datadog's LLM and agent observability: traces model calls and agent steps, runs LLM-judge evals and experiments, bills LLM spans only.
New Relic AI Monitoring
Observability
LLM and agent monitoring inside New Relic APM: model calls traced as spans beside database and service calls, billed as ordinary ingest.
Fiddler AI
Observability
Enterprise ML and LLM agent observability with in-environment guardrails, explainability and fairness metrics.
Laminar
Observability
Open-source observability for AI agents: transcript traces, Signals failure detection, debugger replay and evals, from $30/month.
Free; Pro Cloud from $19/month
Opik (Comet)
Observability
Open-source LLM observability and evaluation from Comet, with agent tracing, datasets, online scoring, prompt versioning, and optimization.
From $20/user/mo
Lunary
Observability
LLM observability platform linking agent traces, chatbot conversations, feedback, prompt templates, and evaluation workflows.
Free tier; Enterprise quote
Traceloop
Observability
LLM tracing, evaluations, and prompt management built around the Apache-2.0 OpenLLMetry SDK. The commercial platform has a free hosted tier and quote-based Enterprise deployment.
Free; Pro from $60/mo Weights & Biases Weave
Observability
LLM observability and evaluation toolkit for tracing AI applications, comparing outputs, and turning failures into repeatable tests.
Helicone
Observability
Proxy-based LLM observability gateway with one-line setup; hosted product in maintenance mode since the March 2026 Mintlify acquisition.
12