Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 17,373
Awesome lists tracked: 125
Current results: 15

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

15 repos shown

Topic: data-pipelines

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Stack

Python Axum FastAPI LangChain pytest Cargo npm PEP 517

GitHub topics

#batch-processing #data-analytics #data-pipelines #data-processing #dataflow #etl

Updated: 2026-07-14
Lists: 3 list mentions
First commit: 2023-07-21
History: 8 history points
License: NOASSERTION
Issues: 35 open

62,661

stars

Forks: 1,668
Commits: 2,118 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-07-17
Lists: 5 list mentions
First commit: 2014-10-06
History: 62 history points
License: Apache-2.0
Issues: 1,739 open

46,152

stars

Forks: 17,393
Commits: 39,742 commits
Star growth, last 7 days: +61 +0.1%
Commit velocity, last 7 days: +101 +0.3%

Website GitHub

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev

Stack

Python FastAPI Flask LangChain Next.js npm PEP 517 pip

GitHub topics

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines

Updated: 2026-07-06
Lists: 4 list mentions
First commit: 2018-04-30
History: 9 history points
License: Apache-2.0
Issues: 2,568 open

15,795

stars

Forks: 2,184
Commits: 27,770 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/dolphinscheduler

Apache DolphinScheduler is the modern data orchestration platform. Agile to create high performance workflow with low-code

AI dev

Stack

Java Spring Boot Vite Vue Maven npm pnpm

GitHub topics

#airflow #azkaban #cloud-native #data-pipelines #job-scheduler #orchestration

Updated: 2026-07-15
Lists: 1 list mention
First commit: 2019-03-01
History: 4 history points
License: Apache-2.0
Issues: 129 open

14,370

stars

Forks: 5,058
Commits: 9,031 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

kedro-org/kedro

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.

AI dev

Stack

Python PEP 517 pip

GitHub topics

#agentic-ai #agentic-workflow #data-pipelines #hacktoberfest #kedro #machine-learning

Updated: 2026-07-14
Lists: 1 list mention
First commit: 2019-05-16
History: 5 history points
License: Apache-2.0
Issues: 158 open

10,917

stars

Forks: 1,052
Commits: 4,354 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack

Python LangChain Next.js pytest React npm PEP 517 pip

GitHub topics

#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science

Updated: 2026-07-02
Lists: 1 list mention
First commit: 2022-05-16
History: 5 history points
License: Apache-2.0
Issues: 617 open

8,769

stars

Forks: 978
Commits: 5,784 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

fluvio-community/fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

Stack

Rust Cargo

GitHub topics

#cloud-native #data-analytics #data-flow #data-integration #data-pipelines #distributed-systems

Updated: 2026-06-23
Lists: 2 list mentions
First commit: 2019-09-04
History: 2 history points
License: Apache-2.0
Issues: 140 open

5,239

stars

Forks: 529
Commits: 2,574 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

orchest/orchest

Build data pipelines, the easy way 🛠️

Archived

Stack

TypeScript Celery Cobra Flask gRPC Go Go modules npm PEP 517

GitHub topics

#airflow #cloud #dag #data-pipelines #data-science #deployment

Updated: 2023-06-06
Lists: 1 list mention
First commit: 2019-11-28
History: 2 history points
License: Apache-2.0
Issues: 130 open

4,136

stars

Forks: 262
Commits: 9,688 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

ucbepic/docetl

A system for agentic LLM-powered data processing and ETL

AI dev

Stack

Python FastAPI Next.js pytest React npm pip uv

GitHub topics

#agents #data #data-pipelines #document-analysis #document-processing #elt

Updated: 2026-06-26
Lists: 1 list mention
First commit: 2024-07-09
History: 48 history points
License: MIT
Issues: 41 open

3,891

stars

Forks: 414
Commits: 914 commits
Star growth, last 7 days: +9 +0.2%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Netflix/maestro

Maestro: Netflix’s Workflow Orchestrator

Stack

Java Spring Boot Gradle

GitHub topics

#agentic-workflow #analytics #automation #batch-processing #dag #data-engineering

Updated: 2026-07-15
Lists: 1 list mention
First commit: 2024-04-17
History: 5 history points
License: Apache-2.0
Issues: 35 open

3,800

stars

Forks: 296
Commits: 164 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

meltano/meltano

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

AI dev

Stack

Python pytest React Tailwind CSS npm PEP 517 pip

GitHub topics

#connectors #data #data-engineering #data-pipelines #dataops #dataops-platform

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2018-04-27
History: 48 history points
License: MIT
Issues: 154 open

2,561

stars

Forks: 255
Commits: 12,866 commits
Star growth, last 7 days: +4 +0.2%
Commit velocity, last 7 days: +14 +0.1%

Website GitHub

bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

AI dev

Stack

Go Cargo Go modules npm

GitHub topics

#analytics #bigquery #data-analysis #data-ingestion #data-modeling #data-pipelines

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2023-07-25
History: 26 history points
License: Apache-2.0
Issues: 33 open

1,642

stars

Forks: 84
Commits: 7,893 commits
Star growth, last 7 days: +3 +0.2%
Commit velocity, last 7 days: +78 +1.0%

Website GitHub

pyper-dev/pyper

Concurrent Python made simple

Stack

Python Bundler PEP 517 pip

GitHub topics

#asyncio #concurrency #data #data-collection #data-engineering #data-pipelines

Updated: 2025-02-04
Lists: 0 list mentions
First commit: 2024-05-22
History: 24 history points
License: MIT
Issues: 5 open

1,518

stars

Forks: 31
Commits: 115 commits
Star growth, last 7 days: -1 -0.1%
Commit velocity, last 7 days: 0 0.0%

GitHub

amphi-ai/amphi-etl

visual data prep powered by python

AI dev

Stack

TypeScript pytest React Tornado npm PEP 517 pip

GitHub topics

#analytics-automation #data #data-analysis #data-pipelines #data-preparation #data-science

Updated: 2026-07-12
Lists: 0 list mentions
First commit: 2024-03-21
History: 46 history points
License: NOASSERTION
Issues: 129 open

1,367

stars

Forks: 103
Commits: 541 commits
Star growth, last 7 days: +3 +0.2%
Commit velocity, last 7 days: +5 +0.9%

Website GitHub

Burla-Cloud/burla

The simplest way to scale Python.

AI dev

Stack

Python FastAPI pytest React Starlette Bun npm Poetry

GitHub topics

#batch-processing #data-pipelines #etl-pipelines #python

Updated: 2026-07-16
Lists: 0 list mentions
First commit: 2024-03-19
History: 46 history points
License: NOASSERTION
Issues: 17 open

254

stars

Forks: 11
Commits: 497 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: +8 +1.6%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing