Sign in
← Back to search
github Archived

bigcode-project/bigcodebench

[ICLR'25] BigCodeBench: Benchmarking Code Generation Towards AGI

2 awesome lists

Quick read

Stars
519
Forks
75
Open issues
30
Commits
1,274

Activity and growth

Latest capture 2026-08-11 03:06

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+18
Stored snapshots
7

Classification

Topics

#agent #agents #benchmark #chatgpt #claude-3 #code-generation #deepseek #function-calling #gemini #gpt-4 #instruction-following #large-language-models #llm #program-synthesis #tool-use

Technology stack

Django Flask pytest

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2024-04-29
First commit
2023-04-15
Last pushed
2026-01-03
GitHub updated
2026-08-07
Last synced
2026-08-11 03:06
Stack scanned
2026-08-11 03:06
Archived
Yes
Sign in to like bigcode-project/bigcodebench
README Open website View on GitHub

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

7 observed captures since 2026-05-27. Observed captures are shown by default.

Stars from first capture +18

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

evalplus/evalplus

Rigourous evaluation of LLM-synthesized code - NeurIPS 2023 & COLM 2024

1,803 stars
Python 2 awesome lists

LiveBench/LiveBench

LiveBench: A Challenging, Contamination-Free LLM Benchmark

1,269 stars
Python 1 awesome list

google/BIG-bench

Beyond the Imitation Game collaborative benchmark for measuring and extrapolating the capabilities of language models

3,249 stars
Python 2 awesome lists

openai/mle-bench

MLE-bench is a benchmark for measuring how well AI agents perform at machine learning engineering

1,661 stars
Python 1 awesome list

EvolvingLMMs-Lab/lmms-eval

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

4,343 stars
Python 1 awesome list