Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 18,423
Awesome lists tracked: 132
Current results: 33

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

33 repos shown

Topic: benchmark

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

sharkdp/hyperfine

A command-line benchmarking tool

Stack

Rust Cargo

GitHub topics

#benchmark #cli #command-line #rust #terminal #tool

Updated: 2026-04-30
Lists: 3 list mentions
First commit: 2018-01-13
History: 4 history points
License: Apache-2.0
Issues: 96 open

28,661

stars

Forks: 507
Commits: 1,018 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

Stack

Python Jupyter pip

GitHub topics

#benchmark #chatgpt #evaluation #large-language-model #llama2 #llama3

Updated: 2026-09-08
Lists: 3 list mentions
First commit: 2023-07-04
History: 7 history points
License: Apache-2.0
Issues: 400 open

7,402

stars

Forks: 862
Commits: 1,228 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

SWE-bench/SWE-bench

SWE-bench: Can Language Models Resolve Real-world Github Issues?

Stack

Python pytest uv

GitHub topics

#benchmark #language-model #software-engineering

Updated: 2026-09-02
Lists: 2 list mentions
First commit: 2023-10-10
History: 8 history points
License: MIT
Issues: 11 open

5,829

stars

Forks: 973
Commits: 746 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

open-mmlab/mmaction2

OpenMMLab's Next Generation Video Understanding Toolbox and Benchmark

Stack

Python pytest pip

GitHub topics

#action-recognition #ava #benchmark #deep-learning #i3d #non-local

Updated: 2026-03-18
Lists: 1 list mention
First commit: 2019-12-15
History: 4 history points
License: Apache-2.0
Issues: 319 open

5,126

stars

Forks: 1,359
Commits: 2,063 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Stack

Python Express FastAPI LangChain pytest npm pip uv

GitHub topics

#agi #audio-evaluation #benchmark #evaluation #large-language-models #llm-evaluation

Updated: 2026-09-08
Lists: 1 list mention
First commit: 2023-12-24
History: 7 history points
License: NOASSERTION
Issues: 60 open

4,396

stars

Forks: 651
Commits: 1,864 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

baichuan-inc/Baichuan2

A series of large language models developed by Baichuan Intelligent Technology

Stack

Python Streamlit pip

GitHub topics

#artificial-intelligence #benchmark #ceval #chatgpt #chinese #gpt

Updated: 2024-11-08
Lists: 2 list mentions
First commit: 2023-09-06
History: 7 history points
License: Apache-2.0
Issues: 282 open

4,086

stars

Forks: 295
Commits: 35 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

RUC-NLPIR/FlashRAG

⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)

Stack

Python Gradio Streamlit PEP 517 pip

GitHub topics

#benchmark #datasets #large-language-models #retrieval-augmented-generation

Updated: 2026-08-21
Lists: 1 list mention
First commit: 2024-03-19
History: 7 history points
License: MIT
Issues: 40 open

3,566

stars

Forks: 314
Commits: 810 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

embeddings-benchmark/mteb

MTEB: State-of-the-art evaluation of embeddings across languages and modalities

Stack

Python FastAPI Gradio pytest uv

GitHub topics

#benchmark #bitext-mining #clustering #embeddings #evaluation #information-retrieval

Updated: 2026-09-09
Lists: 1 list mention
First commit: 2022-04-05
History: 7 history points
License: Apache-2.0
Issues: 332 open

3,418

stars

Forks: 693
Commits: 4,599 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

xlang-ai/OSWorld

[NeurIPS 2024] OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

Stack

Python FastAPI Flask pip uv

GitHub topics

#agent #artificial-intelligence #benchmark #cli #code-generation #gui

Updated: 2026-08-30
Lists: 2 list mentions
First commit: 2023-10-16
History: 1 history point
License: Apache-2.0
Issues: 204 open

3,137

stars

Forks: 533
Commits: 1,466 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

baichuan-inc/Baichuan-13B

A 13B large language model developed by Baichuan Intelligent Technology

Stack

Python Streamlit pip

GitHub topics

#artificial-intelligence #benchmark #ceval #chatgpt #chinese #gpt-4

Updated: 2023-09-06
Lists: 1 list mention
First commit: 2023-07-10
History: 6 history points
License: Apache-2.0
Issues: 96 open

2,929

stars

Forks: 230
Commits: 35 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

itayinbarr/little-coder

A harness optimized to smaller LLMs

AI dev

Stack

TypeScript Vite npm

GitHub topics

#ai-coding-assistant #aider-polygot #benchmark #code-generation #coding-agent #coding-agents

Updated: 2026-08-29
Lists: 1 list mention
First commit: 2026-04-19
History: 1 history point
License: Apache-2.0
Issues: 14 open

2,555

stars

Forks: 177
Commits: 129 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

evanwashere/mitata

benchmark tooling that loves you ❤️

Stack

JavaScript npm

GitHub topics

#benchmark #bun #cpp #deno #graaljs #javascript

Updated: 2025-02-17
Lists: 0 list mentions
First commit: 2022-04-17
History: 43 history points
License: MIT
Issues: 15 open

2,514

stars

Forks: 37
Commits: 73 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

sierra-research/tau2-bench

τ-Bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains

AI dev

Stack

Python FastAPI pytest React Vite npm PEP 517 uv

GitHub topics

#ai #benchmark #conversational-agents #language-model-agent #llm

Updated: 2026-09-07
Lists: 1 list mention
First commit: 2025-06-10
History: 7 history points
License: MIT
Issues: 197 open

1,983

stars

Forks: 507
Commits: 199 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

evalplus/evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

Stack

Python pytest PEP 517 pip

GitHub topics

#benchmark #chatgpt #efficiency #gpt-4 #large-language-models #program-synthesis

Updated: 2025-10-02
Lists: 2 list mentions
First commit: 2023-04-15
History: 7 history points
License: Apache-2.0
Issues: 73 open

1,803

stars

Forks: 206
Commits: 822 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

mlcommons/training

Reference implementations of MLPerf® training benchmarks

Stack

Python Flask Gradio pytest Streamlit pip

GitHub topics

#benchmark #machine-learning

Updated: 2026-08-17
Lists: 1 list mention
First commit: 2018-03-29
History: 7 history points
License: Apache-2.0
Issues: 13 open

1,771

stars

Forks: 593
Commits: 409 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mlcommons/inference

Reference implementations of MLPerf® inference benchmarks

AI dev

Stack

Python LangChain pytest CMake PEP 517 pip

GitHub topics

#benchmark #machine-learning

Updated: 2026-09-02
Lists: 1 list mention
First commit: 2018-09-13
History: 7 history points
License: Apache-2.0
Issues: 201 open

1,624

stars

Forks: 648
Commits: 2,019 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

attaswift/Attabench

Microbenchmarking app for Swift with nice log-log plots

Stack

Swift Swift Package Manager

GitHub topics

#app #benchmark #macos #microbenchmarks #swift

Updated: 2022-02-23
Lists: 1 list mention
First commit: 2017-01-17
History: 10 history points
License: MIT
Issues: 5 open

1,275

stars

Forks: 45
Commits: 185 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

ohler55/agoo

A High Performance HTTP Server for Ruby

Stack

C Bundler

GitHub topics

#benchmark #clustering #clusters #fast #graphql #graphql-server

Updated: 2026-05-09
Lists: 1 list mention
First commit: 2017-12-22
History: 5 history points
License: MIT
Issues: 3 open

933

stars

Forks: 40
Commits: 322 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

bencherdev/bencher

🐰 Bencher - Continuous Benchmarking

AI dev

Stack

Rust Astro Cargo Go modules npm

GitHub topics

#benchmark #benchmarking #cd #ci #ci-cd #code-quality

Updated: 2026-08-30
Lists: 4 list mentions
First commit: 2020-07-25
History: 8 history points
License: NOASSERTION
Issues: 165 open

894

stars

Forks: 40
Commits: 6,153 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

Ayanami0730/deep_research_bench

DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agents

Stack

Python pip

GitHub topics

#agent #benchmark #deepresearch #nlp

Updated: 2026-05-11
Lists: 1 list mention
First commit: 2025-06-13
History: 7 history points
License: Apache-2.0
Issues: 24 open

824

stars

Forks: 84
Commits: 44 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

TheAgentCompany/TheAgentCompany

An agent benchmark with tasks in a simulated software company.

Stack

Python FastAPI Flask pytest pip Poetry

GitHub topics

#agent #ai #ai-benchmark #ai-research #benchmark #llm

Updated: 2025-11-17
Lists: 1 list mention
First commit: 2024-03-11
History: 7 history points
License: MIT
Issues: 25 open

779

stars

Forks: 124
Commits: 729 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

TIGER-AI-Lab/ClawBench

Open-source benchmark for browser AI agents on daily tasks.

AI dev

Stack

Python FastAPI pytest Starlette uv

GitHub topics

#agent-evaluation #agentic-ai #ai-agent-benchmark #ai-agents #benchmark #browser-agent

Updated: 2026-09-05
Lists: 1 list mention
First commit: 2026-04-10
History: 6 history points
License: Apache-2.0
Issues: 52 open

649

stars

Forks: 46
Commits: 491 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

bigcode-project/bigcodebench

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

Archived

Stack

Python Django Flask pytest PEP 517 pip

GitHub topics

#agent #agents #benchmark #chatgpt #claude-3 #code-generation

Updated: 2026-01-03
Lists: 2 list mentions
First commit: 2023-04-15
History: 7 history points
License: Apache-2.0
Issues: 30 open

519

stars

Forks: 75
Commits: 1,274 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

tarasko/picows

Ultra-fast websocket client and server for asyncio

AI dev

Stack

Python pytest PEP 517 pip

GitHub topics

#asyncio #benchmark #cython #cython-library #high-performance #python

Updated: 2026-08-04
Lists: 1 list mention
First commit: 2024-08-08
History: 8 history points
License: MIT
Issues: 3 open

291

stars

Forks: 18
Commits: 937 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

hendriknielaender/zBench

📊 zig benchmark

Stack

Zig

GitHub topics

#bench #benchmark #benchmarking #performance #stdout #testing

Updated: 2026-06-24
Lists: 1 list mention
First commit: 2023-05-25
History: 5 history points
License: MIT
Issues: 8 open

222

stars

Forks: 22
Commits: 231 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

OSU-NLP-Group/Mind2Web-2

[NeurIPS'25 D&B] Mind2Web-2 Benchmark: Evaluating Agentic Search with Agent-as-a-Judge

AI dev

Stack

Python FastAPI PEP 517 pip

GitHub topics

#agents #benchmark #cua #dataset #webagent

Updated: 2026-05-17
Lists: 1 list mention
First commit: 2025-06-08
History: 7 history points
License: MIT
Issues: 1 open

114

stars

Forks: 7
Commits: 82 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

fastxyz/skill-optimizer

Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs

AI dev

Stack

TypeScript Express npm

GitHub topics

#ai #ai-agent #ai-skill #benchmark #cli #eval

Updated: 2026-05-28
Lists: 1 list mention
First commit: 2026-03-10
History: 7 history points
License: MIT
Issues: 14 open

stars

Forks: 12
Commits: 70 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

unum-cloud/ucsb

Wide NoSQL benchmark for RocksDB, LevelDB, Redis, WiredTiger and MongoDB extending the Yahoo Cloud Serving Benchmark

Stack

C++ CMake

GitHub topics

#benchmark #database #ebpf #google-benchmark #io-uring #leveldb

Updated: 2023-09-08
Lists: 1 list mention
First commit: 2021-12-08
History: 7 history points
License: Unknown
Issues: 3 open

stars

Forks: 6
Commits: 968 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

reacher-z/HarnessBench

Benchmark for comparing agent harnesses on everyday online tasks — fixes the base model, varies the harness. Sister project of ClawBench, same scoring pipeline.

Stack

Python pytest PEP 517

GitHub topics

#agent-evaluation #agent-harness #agentic-ai #ai-agents #benchmark #browser-agent

Updated: 2026-07-17
Lists: 1 list mention
First commit: 2026-04-16
History: 6 history points
License: Apache-2.0
Issues: 13 open

stars

Forks: 4
Commits: 7 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

TIGER-AI-Lab/StructEval

Evaluating LLMs' abilities to generate structural output [TMLR2025]

Stack

Python pip

GitHub topics

#benchmark #evaluation #structure

Updated: 2026-07-26
Lists: 1 list mention
First commit: 2025-01-03
History: 2 history points
License: Apache-2.0
Issues: 6 open

stars

Forks: 7
Commits: 49 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing