github Actively maintained

huggingface/lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

Quick read

Stars
2,501
Forks
521
Open issues
364
Commits
586

Activity and growth

Latest capture 2026-08-03 03:03

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+73
Stored snapshots
6

Classification

Metadata

Language
Python
License
MIT
Default branch
main
Created
2024-01-26
First commit
2024-01-26
Last pushed
2026-06-29
GitHub updated
2026-08-01
Last synced
2026-08-03 03:03
Stack scanned
2026-08-03 03:03
Archived
No

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

6 observed captures since 2026-05-25. Observed captures are shown by default.

Stars from first capture +73

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

4,343 stars
Python 1 awesome list

evalplus/evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

1,803 stars
Python 2 awesome lists

open-compass/VLMEvalKit

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

4,321 stars
Python 2 awesome lists

modelscope/evalscope

A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.

3,177 stars
Python 3 awesome lists