Repository profile
RAG evaluation without the need for "golden answers"
Repository updates
Get generated vectara/open-rag-eval development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-13 03:07
5 captures since 2026-05-23
Stars from baseline +18
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-13 03:07
requirements-dev.txt
python ecosystem,
7 dependencies
requirements.txt
python ecosystem,
28 dependencies
setup.py
python ecosystem,
0 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
AI agent config detected
Key config paths
Nearest indexed repositories by embedding similarity.
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)
Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.
The LLM Evaluation Framework
Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view
Supercharge Your LLM Application Evaluations 🚀
