Evaluation Cards
A shared reporting schema and open platform, built with the UK AI Security Institute, for making AI benchmark results comparable across setups.
Overview
The EvalEval Coalition, working with the UK AI Security Institute (AISI), launched Evaluation Cards on September 22, 2026, an open platform and shared reporting schema that consolidates benchmark metadata, evaluation-run data, and model information into unified, comparable records. It uses the 'Every Eval Ever' (EEE) schema for structured documentation, provides transcript-level transparency for reproducibility, and surfaces contextual information about how setup choices affect reported performance. Model developers can submit verified results, evaluation developers can report benchmarks using the EEE schema, and researchers can browse cards by benchmark or model at evalcards.evalevalai.com.
This is a sourced directory entry. Features and capabilities are reported in the linked sources; this entry does not document independent Aymorphic testing.
Key features
- Shared 'Every Eval Ever' (EEE) reporting schema across benchmarks and models
- Transcript-level transparency for reproducibility and analysis
- Contextual notes on how evaluation setup choices affect reported scores
- Verified result submission for model developers
- Browsable by benchmark or by model
Use cases
- Comparing benchmark results across models and evaluation setups on equal footing
- Auditing evaluation methodology via transcript-level detail
- Standardized benchmark reporting for evaluation-tooling developers
Pricing
Free to use; available at evalcards.evalevalai.com.
Pricing reflects the source record and may change. Confirm current terms with the provider.
Dates and sources
- Released
- 22 Sept 2026
- Record updated
- 24 Sept 2026
- Record last checked
- 24 Sept 2026