Repository profile
🤗 Evaluate: A library for easily evaluating machine learning models and datasets.
Repository updates
Get generated huggingface/evaluate development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-15 03:13
5 captures since 2026-05-25
Stars from baseline +17
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-15 03:13
setup.cfg
python ecosystem,
0 dependencies
setup.py
python ecosystem,
0 dependencies
.github/hub/requirements.txt
python ecosystem,
1 dependency
comparisons/exact_match/requirements.txt
python ecosystem,
1 dependency
comparisons/mcnemar/requirements.txt
python ecosystem,
1 dependency
comparisons/wilcoxon/requirements.txt
python ecosystem,
2 dependencies
measurements/honest/requirements.txt
python ecosystem,
3 dependencies
measurements/label_distribution/requirements.txt
python ecosystem,
1 dependency
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
Nearest indexed repositories by embedding similarity.
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
Machine learning model evaluation made easy: plots, tables, HTML reports, experiment tracking and Jupyter notebook analysis.
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024
Evidently is an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.
