← Back to search
github Active AI dev

Repository profile

huggingface/datatrove

Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

Python Apache-2.0 main Stack scanned README.md
Stars
3,157
Forks
279
Watchers
48
Issues
91
Commits
726
Awesome lists
2

Repository updates

Follow repository updates

Get generated huggingface/datatrove development summaries by email, or follow the weekly and monthly RSS feeds.

Sign in to subscribe by email. RSS feeds are public.

Sign in to subscribe

Activity and growth

Tracked growth, recent movement, and commit velocity from stored repository snapshots.

Latest capture 2026-07-15 03:13

Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
Stars since baseline
+91
Snapshot coverage
5

Tracked growth

5 captures since 2026-05-25

Stars from baseline +91

Time horizon

All tracked data

Stars history

Total stars

Commits history

Default branch commits

Detected stack

Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.

Scanned 2026-07-15 03:13

Stack signals
2
Package managers
3
Manifest files
4
Dependencies
304

Frameworks and tools

  • Flask web framework · high confidence
  • pytest test framework · high confidence
Cargo PEP 517 uv python rust

Dependency files

4 manifests
  • pyproject.toml python ecosystem, 61 dependencies
  • uv.lock python ecosystem, 0 dependencies
  • src/datatrove/tools/fast_mh3/Cargo.toml rust ecosystem, 8 dependencies
  • src/datatrove/tools/fast_mh3/Cargo.lock rust ecosystem, 235 dependencies

Classification

Searchable topics, generated tags, and stack labels that explain where this repository fits.

Topics
0
Tags
0
Stacks
2

Topics

No topics indexed.

Generated tags

No generated tags yet.

Stack labels

AI development signals

Agent instructions and tool configuration paths found in the repository tree.

1 path

AI agent config detected

1 config path 1 file 0 directories
Agent instructions

Key config paths

Similar repositories

Nearest indexed repositories by embedding similarity.

PKU-YuanGroup/Helios

Helios: Real Real-Time Long Video Generation Model

1,980 stars
Python 1 awesome list

RUC-NLPIR/FlashRAG

⚡FlashRAG: A Python Toolkit for Efficient RAG Research (WWW2025 Resource)

3,521 stars
Python 1 awesome list

melih-unsal/DemoGPT

🤖 Create LLM agents in a second with your prompts. Everything you need to create an LLM Agent - tools, prompts, frameworks, and models - all in one place.

1,901 stars
Python 3 awesome lists

MigoXLab/dingo

Dingo: A Comprehensive AI Data, Model and Application Quality Evaluation Tool

725 stars
Python 2 awesome lists

SkyworkAI/SkyReels-V2

SkyReels-V2: Infinite-length Film Generative model

7,202 stars
Python 1 awesome list

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-06-14
First commit
2023-06-14
Last pushed
2026-07-14
GitHub updated
2026-07-14
Last synced
2026-07-15 03:13
Stack detected
2026-07-15 03:13
Archived
no

Appears in

2