Sign in
← All awesome lists Search these repos

Awesome List

Awesome Agent Harness

An awesome list of Agent Harness engineering resources, including GitHub projects, tools, benchmarks, and practical guides.

Picrew/awesome-agent-harness #agent-harness #context-engineering #harness-engineering
Open GitHub
List stars
1,702
README repos
333
Indexed repos
332
List commits
34
Forks
179
Open issues
62

Tracked list growth

GitHub stars and default-branch commits for Picrew/awesome-agent-harness.

Latest scan 2026-09-03 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

4 repos matching these filters.

Topic: evaluation-framework
Latest repo push 2026-09-04

Filter this list

Search within Awesome Agent Harness or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

promptfoo/promptfoo

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative configs with command line and CI/CD integration. Used by OpenAI and Anthropic.

AI dev
Stack
TypeScript Express FastAPI Gradio PydanticAI Go modules npm PEP 517
GitHub topics
#ci #ci-cd #cicd #evaluation #evaluation-framework #llm
Updated
2026-08-22
Lists
8 list mentions
First commit
2023-03-31
License
MIT
Issues
517 open
Sign in to like promptfoo/promptfoo
24,471
stars
Forks
2,220
Commits
9,424 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
confident-ai/deepeval

The LLM Evaluation Framework

Stack
Python LangChain LlamaIndex Next.js pytest npm Poetry Yarn
GitHub topics
#evaluation-framework #evaluation-metrics #llm-evaluation #llm-evaluation-framework #llm-evaluation-metrics #python
Updated
2026-09-03
Lists
6 list mentions
First commit
2023-08-10
License
Apache-2.0
Issues
559 open
Sign in to like confident-ai/deepeval
18,091
stars
Forks
1,892
Commits
10,221 commits
Star growth, last 7 days
+153 +0.9%
Commit velocity, last 7 days
+59 +0.6%
Website GitHub
future-agi/future-agi

Open-source, end-to-end platform for evaluating, observing, and improving LLM and AI agent applications. Tracing · Evals · Simulations · Datasets · Gateway · Guardrails. Self-hostable. Apache 2.0.

Stack
Python Celery Django Django REST Framework FastAPI Go modules npm PEP 517
GitHub topics
#ai-agents #ai-evals #ai-gateway #ai-optimization #ai-simulations #evaluation-framework
Updated
2026-08-01
Lists
5 list mentions
First commit
2026-04-23
License
Apache-2.0
Issues
596 open
Sign in to like future-agi/future-agi
1,544
stars
Forks
445
Commits
3,574 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub