Sign in
← All awesome lists Search these repos

Awesome List

Awesome Harness Engineering

Awesome list for AI agent harness engineering: tools, patterns, evals, memory, MCP, permissions, observability, and orchestration.

ai-boost/awesome-harness-engineering #agent-harness #agent-memory #agent-orchestration #ai-agent-harness #ai-agents #awesome-list #context-engineering #harness-engineering #mcp
Open GitHub
List stars
3,975
README repos
232
Indexed repos
158
List commits
108
Forks
487
Open issues
177

Tracked list growth

GitHub stars and default-branch commits for ai-boost/awesome-harness-engineering.

Latest scan 2026-09-03 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

3 repos matching these filters.

Topic: evaluation-framework
Latest repo push 2026-09-04

Filter this list

Search within Awesome Harness Engineering or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

AI dev
Stack
TypeScript Express FastAPI Gradio PydanticAI Go modules npm PEP 517
GitHub topics
#ci #ci-cd #cicd #evaluation #evaluation-framework #llm
Updated
2026-08-22
Lists
8 list mentions
First commit
2023-03-31
License
MIT
Issues
517 open
Sign in to like promptfoo/promptfoo
24,471
stars
Forks
2,220
Commits
9,424 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
confident-ai/deepeval

The LLM Evaluation Framework

Stack
Python LangChain LlamaIndex Next.js pytest npm Poetry Yarn
GitHub topics
#evaluation-framework #evaluation-metrics #llm-evaluation #llm-evaluation-framework #llm-evaluation-metrics #python
Updated
2026-09-03
Lists
6 list mentions
First commit
2023-08-10
License
Apache-2.0
Issues
559 open
Sign in to like confident-ai/deepeval
18,091
stars
Forks
1,892
Commits
10,221 commits
Star growth, last 7 days
+153 +0.9%
Commit velocity, last 7 days
+59 +0.6%
Website GitHub
future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Stack
Python Celery Django Django REST Framework FastAPI Go modules npm PEP 517
GitHub topics
#ai-agents #ai-evals #ai-gateway #ai-optimization #ai-simulations #evaluation-framework
Updated
2026-08-01
Lists
5 list mentions
First commit
2026-04-23
License
Apache-2.0
Issues
596 open
Sign in to like future-agi/future-agi
1,544
stars
Forks
445
Commits
3,574 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub