Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome
GitHub projects from awesome lists
Search awesome repositories
Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.
- Repos indexed
- 18,423
- Awesome lists tracked
- 132
- Current results
- 7
7 repos shown
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
AI dev
GitHub topics
- Updated
- 2026-08-22
- Lists
- 8 list mentions
- First commit
- 2023-03-31
- History
- 10 history points
- License
- MIT
- Issues
- 517 open
24,471
stars
- Forks
- 2,220
- Commits
- 9,424 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
confident-ai/deepeval
The LLM Evaluation Framework
- Updated
- 2026-09-14
- Lists
- 6 list mentions
- First commit
- 2023-08-10
- History
- 110 history points
- License
- Apache-2.0
- Issues
- 605 open
18,285
stars
- Forks
- 1,934
- Commits
- 10,249 commits
- Star growth, last 7 days
- +87 +0.5%
- Commit velocity, last 7 days
- +21 +0.2%
EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
GitHub topics
- Updated
- 2026-09-01
- Lists
- 4 list mentions
- First commit
- 2020-08-28
- History
- 9 history points
- License
- MIT
- Issues
- 952 open
13,922
stars
- Forks
- 3,548
- Commits
- 4,114 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
Kiln-AI/Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
AI dev
GitHub topics
- Updated
- 2026-09-08
- Lists
- 1 list mention
- First commit
- 2024-08-02
- History
- 7 history points
- License
- NOASSERTION
- Issues
- 74 open
5,048
stars
- Forks
- 377
- Commits
- 7,548 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
huggingface/lighteval
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
GitHub topics
- Updated
- 2026-08-11
- Lists
- 3 list mentions
- First commit
- 2024-01-26
- History
- 7 history points
- License
- MIT
- Issues
- 407 open
2,537
stars
- Forks
- 553
- Commits
- 587 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
future-agi/future-agi
Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.
AI dev
- Updated
- 2026-09-07
- Lists
- 5 list mentions
- First commit
- 2026-04-23
- History
- 8 history points
- License
- Apache-2.0
- Issues
- 809 open
1,943
stars
- Forks
- 583
- Commits
- 4,849 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
fastxyz/skill-optimizer
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs
AI dev
Stack
- Updated
- 2026-05-28
- Lists
- 1 list mention
- First commit
- 2026-03-10
- History
- 7 history points
- License
- MIT
- Issues
- 14 open
- Forks
- 12
- Commits
- 70 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
