Free open source; Enterprise self-hosted by quote Evidently AI
Evals
Open-source Python library for LLM output evals with LLM judges, plus data drift and model quality reports and a self-hostable dashboard.
Evals
Loading tools…
Free open source; Enterprise self-hosted by quote 
Maxim AI
Evals
Agent simulation, evaluation and observability platform that tests multi-turn chat and voice agents with simulated users, evaluators and tracing.
Openlayer
Evals
AI testing, tracing and governance platform: 100+ catalog tests in CI and on live traces, guardrails, Gateway, EU AI Act mapping.
Confident AI (DeepEval)
Evals
LLM evaluation and observability platform built on open-source DeepEval: 50+ metrics for tests, CI and live production traces.
Free open source; usage costs extra
TruLens
Evals
Open-source Python framework for evaluating RAG applications and AI agents with configurable metrics, OpenTelemetry traces, and version comparisons.
Promptfoo
Evals
Open-source CLI for LLM evals and red teaming: YAML test suites, 60+ providers, CI gates and 157 attack plugins, now owned by OpenAI.
Free open source; enterprise by email Ragas
Evals
Open-source Python library for scoring RAG and LLM apps with LLM-judged metrics and generating synthetic test questions from your documents.
Galileo
Evals
LLM and agent eval platform with 31 built-in metrics, Luna-2 judge models and production Signals, now sold as Splunk Agent Observability.
Braintrust
Evals
Eval-first platform for AI products: datasets, experiments, CI-gated scoring, and a hybrid VPC data plane; bills scores, not traces.