Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 17,373
Awesome lists tracked: 125
Current results: 11

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

11 repos shown

Topic: data-processing

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Stack

Python Axum FastAPI LangChain pytest Cargo npm PEP 517

GitHub topics

#batch-processing #data-analytics #data-pipelines #data-processing #dataflow #etl

Updated: 2026-07-14
Lists: 3 list mentions
First commit: 2023-07-21
History: 8 history points
License: NOASSERTION
Issues: 35 open

62,661

stars

Forks: 1,668
Commits: 2,118 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

johnkerl/miller

Miller is like awk, sed, cut, join, and sort for name-indexed data such as CSV, TSV, and tabular JSON

AI dev

Stack

Go Go modules pip

GitHub topics

#command-line #command-line-tools #csv #csv-format #data-cleaning #data-processing

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2015-05-03
History: 4 history points
License: NOASSERTION
Issues: 73 open

9,952

stars

Forks: 238
Commits: 9,392 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

TomWright/dasel

Unified querying, transformation, and modification of JSON, TOML, YAML, XML, INI, HCL, KDL and CSV.

Stack

Go Go modules

GitHub topics

#cli #config #configuration #data-processing #data-structures #data-wrangling

Updated: 2026-06-27
Lists: 1 list mention
First commit: 2020-09-22
History: 6 history points
License: MIT
Issues: 20 open

7,988

stars

Forks: 167
Commits: 874 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

datajuicer/data-juicer

Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷

Stack

Python FastAPI pytest Streamlit uv

GitHub topics

#data #data-analysis #data-pipeline #data-processing #data-science #data-visualization

Updated: 2026-07-14
Lists: 1 list mention
First commit: 2023-08-01
History: 5 history points
License: Apache-2.0
Issues: 66 open

6,718

stars

Forks: 393
Commits: 578 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

NVIDIA/DALI

A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

AI dev

Stack

C++ CMake PEP 517 pip

GitHub topics

#audio-processing #data-augmentation #data-processing #deep-learning #fast-data-pipeline #gpu

Updated: 2026-07-15
Lists: 1 list mention
First commit: 2018-06-01
History: 5 history points
License: Apache-2.0
Issues: 219 open

5,723

stars

Forks: 670
Commits: 4,317 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

unionai-oss/pandera

A light-weight, flexible, and expressive statistical data testing library

AI dev

Stack

Python FastAPI pytest pip uv

GitHub topics

#assertions #data-assertions #data-check #data-cleaning #data-processing #data-validation

Updated: 2026-07-16
Lists: 3 list mentions
First commit: 2018-11-01
History: 9 history points
License: MIT
Issues: 436 open

4,407

stars

Forks: 420
Commits: 1,201 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

numaproj/numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

Stack

Rust Axum Cobra Gin gRPC Go Cargo Go modules npm

GitHub topics

#data-processing #hacktoberfest #k8s #kubernetes #map-reduce #pipeline

Updated: 2026-07-11
Lists: 1 list mention
First commit: 2022-05-20
History: 5 history points
License: Apache-2.0
Issues: 286 open

2,822

stars

Forks: 162
Commits: 1,828 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

datachain-ai/datachain

The Context Layer for unstructured data: typed, versioned datasets over S3, GCS, Azure

AI dev

Stack

Python PEP 517

GitHub topics

#ai-agents #claude-code #codex #data-context-layer #data-processing #harness-engineering

Updated: 2026-07-17
Lists: 1 list mention
First commit: 2024-06-25
History: 25 history points
License: Apache-2.0
Issues: 71 open

2,798

stars

Forks: 149
Commits: 1,127 commits
Star growth, last 7 days: +4 +0.1%
Commit velocity, last 7 days: +9 +0.8%

Website GitHub

pyper-dev/pyper

Concurrent Python made simple

Stack

Python Bundler PEP 517 pip

GitHub topics

#asyncio #concurrency #data #data-collection #data-engineering #data-pipelines

Updated: 2025-02-04
Lists: 0 list mentions
First commit: 2024-05-22
History: 24 history points
License: MIT
Issues: 5 open

1,518

stars

Forks: 31
Commits: 115 commits
Star growth, last 7 days: -1 -0.1%
Commit velocity, last 7 days: 0 0.0%

GitHub

svenkreiss/pysparkling

A pure Python implementation of Apache Spark's RDD and DStream interfaces.

Stack

Python pytest Tornado pip

GitHub topics

#apache-spark #data-processing #data-science #python

Updated: 2024-09-03
Lists: 1 list mention
First commit: 2015-05-09
History: 6 history points
License: NOASSERTION
Issues: 11 open

270

stars

Forks: 45
Commits: 1,534 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

bordanattila/OpenF1_tutorial

Interactive F1 strategy dashboard tutorial using the OpenF1 API, Streamlit, Plotly, and pandas.

Stack

Python Streamlit pip

GitHub topics

#data-processing #data-visualization #f1 #formula1 #openf1 #plotly

Updated: 2025-05-29
Lists: 0 list mentions
First commit: 2025-05-29
History: 46 history points
License: Unknown
Issues: 1 open

stars

Forks: 17
Commits: 1 commit
Star growth, last 7 days: +1 +1.8%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing