Sign in
← Back to search
github Actively maintained

open-compass/VLMEvalKit

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

2 awesome lists

Quick read

Stars
4,321
Forks
739
Open issues
273
Commits
1,776

Activity and growth

Latest capture 2026-08-03 03:06

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+170
Stored snapshots
6

Classification

Topics

#chatgpt #claude #clip #computer-vision #evaluation #gemini #gpt #gpt-4v #gpt4 #large-language-models #llava #llm #multi-modal #openai #openai-api #pytorch #qwen #vit #vqa

Technology stack

Gradio

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-12-01
First commit
2023-11-25
Last pushed
2026-07-31
GitHub updated
2026-08-02
Last synced
2026-08-03 03:06
Stack scanned
2026-08-03 03:06
Archived
No
Sign in to like open-compass/VLMEvalKit
README Open website View on GitHub

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

6 observed captures since 2026-05-25. Observed captures are shown by default.

Stars from first capture +170

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

open-compass/opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

7,261 stars
Python 3 awesome lists

EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

4,343 stars
Python 1 awesome list

huggingface/lighteval

Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

2,501 stars
Python 3 awesome lists

evalplus/evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

1,803 stars
Python 2 awesome lists

ludwig-ai/ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

11,746 stars
Python 3 awesome lists

NVlabs/VILA

VILA is a family of state-of-the-art vision language models (VLMs) for diverse multimodal AI tasks across the edge, data center, and cloud.

3,846 stars
Python 1 awesome list