Confident AI (DeepEval)
Evals
LLM evaluation and observability platform built on open-source DeepEval: 50+ metrics for tests, CI and live production traces.
Evals
Loading tools…
Free open source; usage costs extra
TruLens
Evals
Open-source Python framework for evaluating RAG applications and AI agents with configurable metrics, OpenTelemetry traces, and version comparisons.
Promptfoo
Evals
Open-source CLI for LLM evals and red teaming: YAML test suites, 60+ providers, CI gates and 157 attack plugins, now owned by OpenAI.
Free open source; enterprise by email Ragas
Evals
Open-source Python library for scoring RAG and LLM apps with LLM-judged metrics and generating synthetic test questions from your documents.
Galileo
Evals
LLM and agent eval platform with 31 built-in metrics, Luna-2 judge models and production Signals, now sold as Splunk Agent Observability.
Braintrust
Evals
Eval-first platform for AI products: datasets, experiments, CI-gated scoring, and a hybrid VPC data plane; bills scores, not traces.