modelscope/evalscope
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
Repository profile
Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool
Repository updates
Get generated MigoXLab/dingo development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-15 03:07
8 captures since 2026-05-22
Stars from baseline +23
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-15 03:07
requirements.txt
python ecosystem,
0 dependencies
setup.cfg
python ecosystem,
0 dependencies
setup.py
python ecosystem,
0 dependencies
requirements/agent.txt
python ecosystem,
4 dependencies
requirements/contribute.txt
python ecosystem,
1 dependency
requirements/docs.txt
python ecosystem,
4 dependencies
requirements/hhem_integration.txt
python ecosystem,
4 dependencies
requirements/optional.txt
python ecosystem,
13 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
AI agent config detected
Nearest indexed repositories by embedding similarity.
A streamlined and customizable framework for efficient large model (LLM, VLM, AIGC) evaluation and performance benchmarking.
The LLM Evaluation Framework
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including CrewAI, Agno, OpenAI Agents SDK, Langchain, Autogen, AG2, and CamelAI
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Everything Local & Encrypted.
Evaluate and improve models and agents using environments
PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 lines of code with built-in memory, RAG, and support for 100+ LLMs.