github Actively maintained

huggingface/datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

2 awesome lists

Quick read

Stars
3,244
Forks
286
Open issues
90
Commits
730

Activity and growth

Latest capture 2026-08-03 03:03

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+178
Stored snapshots
6

Classification

Technology stack

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-06-14
First commit
2023-06-14
Last pushed
2026-07-31
GitHub updated
2026-08-03
Last synced
2026-08-03 03:03
Stack scanned
2026-08-03 03:03
Archived
No

AI development signals

1 path

Agent instructions and tool configuration found in this repository.

Agent instructions

View paths

Growth history

Tracked growth

6 observed captures since 2026-05-25. Observed captures are shown by default.

Stars from first capture +178

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

RUC-NLPIR/FlashRAG

⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)

3,537 stars
Python 1 awesome list

PKU-YuanGroup/Helios

Helios: Real Real-Time Long Video Generation Model

2,019 stars
Python 1 awesome list

melih-unsal/DemoGPT

🤖 Create agentic apps in a second with your prompts. Everything you need to create an LLM Agent - tools, prompts, frameworks, and models - all in one place.

1,907 stars
Python 3 awesome lists

codejunkie99/agentic-stack

One brain, many harnesses. Portable .agent/ folder (memory + skills + protocols) that plugs into Claude Code, Cursor, Windsurf, OpenCode, OpenClaw, Hermes, or DIY Python — and keeps its knowledge when you switch.

2,248 stars
Python 2 awesome lists

SkyworkAI/SkyReels-V2

SkyReels-V2: Infinite-length Film Generative model

7,279 stars
Python 1 awesome list