Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome
GitHub projects from awesome lists
Search awesome repositories
Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.
- Repos indexed
- 17,373
- Awesome lists tracked
- 125
- Current results
- 6
6 repos shown
promptfoo/promptfoo
Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.
AI dev
GitHub topics
- Updated
- 2026-07-07
- Lists
- 7 list mentions
- First commit
- 2023-03-31
- History
- 8 history points
- License
- MIT
- Issues
- 397 open
22,984
stars
- Forks
- 2,049
- Commits
- 9,142 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
confident-ai/deepeval
The LLM Evaluation Framework
- Updated
- 2026-07-16
- Lists
- 5 list mentions
- First commit
- 2023-08-10
- History
- 51 history points
- License
- Apache-2.0
- Issues
- 364 open
16,904
stars
- Forks
- 1,668
- Commits
- 9,809 commits
- Star growth, last 7 days
- +141 +0.8%
- Commit velocity, last 7 days
- +6 +0.1%
EleutherAI/lm-evaluation-harness
A framework for few-shot evaluation of language models.
GitHub topics
- Updated
- 2026-07-13
- Lists
- 4 list mentions
- First commit
- 2020-08-28
- History
- 7 history points
- License
- MIT
- Issues
- 911 open
13,282
stars
- Forks
- 3,408
- Commits
- 4,037 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
Kiln-AI/Kiln
Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.
AI dev
GitHub topics
- Updated
- 2026-07-14
- Lists
- 1 list mention
- First commit
- 2024-08-02
- History
- 5 history points
- License
- NOASSERTION
- Issues
- 62 open
4,965
stars
- Forks
- 376
- Commits
- 6,936 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
huggingface/lighteval
Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends
GitHub topics
- Updated
- 2026-06-29
- Lists
- 2 list mentions
- First commit
- 2024-01-26
- History
- 5 history points
- License
- MIT
- Issues
- 353 open
2,476
stars
- Forks
- 510
- Commits
- 586 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
fastxyz/skill-optimizer
Benchmark, evaluate, and optimize skills to ensure reliable performance across all LLMs
AI dev
Stack
- Updated
- 2026-05-28
- Lists
- 1 list mention
- First commit
- 2026-03-10
- History
- 5 history points
- License
- MIT
- Issues
- 13 open
- Forks
- 11
- Commits
- 70 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
