Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 17,373
Awesome lists tracked: 125
Current results: 26

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

26 repos shown

Topic: etl

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Stack

Python Axum FastAPI LangChain pytest Cargo npm PEP 517

GitHub topics

#batch-processing #data-analytics #data-pipelines #data-processing #dataflow #etl

Updated: 2026-07-14
Lists: 3 list mentions
First commit: 2023-07-21
History: 8 history points
License: NOASSERTION
Issues: 35 open

62,661

stars

Forks: 1,668
Commits: 2,118 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-07-17
Lists: 5 list mentions
First commit: 2014-10-06
History: 62 history points
License: Apache-2.0
Issues: 1,739 open

46,152

stars

Forks: 17,393
Commits: 39,742 commits
Star growth, last 7 days: +61 +0.1%
Commit velocity, last 7 days: +101 +0.3%

Website GitHub

kestra-io/kestra

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

AI dev

Stack

Java Micronaut React Vite Vue Gradle npm

GitHub topics

#ai-agents #automation #control-plane #data-engineering #data-orchestration #data-orchestrator

Updated: 2026-07-06
Lists: 3 list mentions
First commit: 2019-08-13
History: 6 history points
License: Apache-2.0
Issues: 541 open

27,263

stars

Forks: 2,650
Commits: 11,173 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

vectordotdev/vector

A high-performance observability data pipeline.

AI dev

Stack

Rust Axum React Tailwind CSS Warp Cargo npm pip

GitHub topics

#agent #cloud-native #data-transformation #datadog #etl #events

Updated: 2026-07-16
Lists: 3 list mentions
First commit: 2018-09-13
History: 4 history points
License: MPL-2.0
Issues: 2,488 open

22,187

stars

Forks: 2,205
Commits: 13,926 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

AI dev

Stack

Python Gradle npm PEP 517

GitHub topics

#bigquery #change-data-capture #data #data-analysis #data-collection #data-engineering

Updated: 2026-07-16
Lists: 2 list mentions
First commit: 2020-07-28
History: 69 history points
License: NOASSERTION
Issues: 2,504 open

21,638

stars

Forks: 5,255
Commits: 49,318 commits
Star growth, last 7 days: +33 +0.2%
Commit velocity, last 7 days: +405 +0.8%

Website GitHub

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev

Stack

Python FastAPI Flask LangChain Next.js npm PEP 517 pip

GitHub topics

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines

Updated: 2026-07-06
Lists: 4 list mentions
First commit: 2018-04-30
History: 9 history points
License: Apache-2.0
Issues: 2,568 open

15,795

stars

Forks: 2,184
Commits: 27,770 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack

Python LangChain Next.js pytest React npm PEP 517 pip

GitHub topics

#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science

Updated: 2026-07-02
Lists: 1 list mention
First commit: 2022-05-16
History: 5 history points
License: Apache-2.0
Issues: 617 open

8,769

stars

Forks: 978
Commits: 5,784 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

redpanda-data/connect

Fancy stream processing made operationally mundane

AI dev

Stack

Go Cobra Gin gRPC Go Starlette Go modules PEP 517 pip

GitHub topics

#amqp #cqrs #data-engineering #data-ops #etl #event-sourcing

Updated: 2026-07-07
Lists: 1 list mention
First commit: 2015-08-25
History: 2 history points
License: Unknown
Issues: 287 open

8,699

stars

Forks: 947
Commits: 7,513 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

AI dev

Stack

Go Cobra gRPC Go pytest Go modules Gradle npm

GitHub topics

#airbyte #attack-surface-management #aws #azure #bigquery #cspm

Updated: 2026-07-06
Lists: 2 list mentions
First commit: 2020-11-18
History: 2 history points
License: MPL-2.0
Issues: 155 open

6,453

stars

Forks: 550
Commits: 22,287 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

Eventual-Inc/Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

AI dev

Stack

Rust Cargo CMake PEP 517

GitHub topics

#ai-engineering #ai-pipeline #arrow #artificial-intelligence #big-data #data-engineering

Updated: 2026-07-17
Lists: 0 list mentions
First commit: 2022-05-10
History: 24 history points
License: Apache-2.0
Issues: 353 open

5,634

stars

Forks: 522
Commits: 4,492 commits
Star growth, last 7 days: +14 +0.2%
Commit velocity, last 7 days: +8 +0.2%

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Cobra Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-07-06
Lists: 3 list mentions
First commit: 2019-07-19
History: 6 history points
License: NOASSERTION
Issues: 36 open

4,452

stars

Forks: 53
Commits: 6,582 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

orchest/orchest

Build data pipelines, the easy way 🛠️

Archived

Stack

TypeScript Celery Cobra Flask gRPC Go Go modules npm PEP 517

GitHub topics

#airflow #cloud #dag #data-pipelines #data-science #deployment

Updated: 2023-06-06
Lists: 1 list mention
First commit: 2019-11-28
History: 2 history points
License: Apache-2.0
Issues: 130 open

4,136

stars

Forks: 262
Commits: 9,688 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

aws/aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Stack

Python pytest PEP 517 pip uv

GitHub topics

#amazon-athena #amazon-sagemaker-notebook #apache-arrow #apache-parquet #athena #aws

Updated: 2026-07-14
Lists: 1 list mention
First commit: 2019-02-26
History: 8 history points
License: Apache-2.0
Issues: 48 open

4,117

stars

Forks: 736
Commits: 2,769 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

ucbepic/docetl

A system for agentic LLM-powered data processing and ETL

AI dev

Stack

Python FastAPI Next.js pytest React npm pip uv

GitHub topics

#agents #data #data-pipelines #document-analysis #document-processing #elt

Updated: 2026-06-26
Lists: 1 list mention
First commit: 2024-07-09
History: 48 history points
License: MIT
Issues: 41 open

3,891

stars

Forks: 414
Commits: 914 commits
Star growth, last 7 days: +9 +0.2%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Netflix/maestro

Maestro: Netflix’s Workflow Orchestrator

Stack

Java Spring Boot Gradle

GitHub topics

#agentic-workflow #analytics #automation #batch-processing #dag #data-engineering

Updated: 2026-07-15
Lists: 1 list mention
First commit: 2024-04-17
History: 5 history points
License: Apache-2.0
Issues: 35 open

3,800

stars

Forks: 296
Commits: 164 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

SQLMesh/sqlmesh

Scalable and efficient data transformation framework - backwards compatible with dbt.

AI dev

Stack

Python npm PEP 517 pip

GitHub topics

#dataengineering #dataops #dbt #elt #etl #python

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2022-09-23
History: 25 history points
License: Apache-2.0
Issues: 256 open

3,200

stars

Forks: 413
Commits: 4,641 commits
Star growth, last 7 days: +15 +0.5%
Commit velocity, last 7 days: +4 +0.1%

Website GitHub

apache/hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Stack

Jupyter Notebook Django FastAPI Jupyter LangChain npm PEP 517 pip

GitHub topics

#dag #data-analysis #data-engineering #data-science #dataframe #etl

Updated: 2026-07-13
Lists: 2 list mentions
First commit: 2019-07-25
History: 7 history points
License: Apache-2.0
Issues: 154 open

2,545

stars

Forks: 198
Commits: 2,038 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Stack

Python pytest PEP 517 pip

GitHub topics

#data #data-integration #etl #pipeline #postgresql #python

Updated: 2023-12-15
Lists: 1 list mention
First commit: 2018-04-08
History: 56 history points
License: MIT
Issues: 26 open

2,089

stars

Forks: 100
Commits: 172 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

Multiwoven/multiwoven

🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.

Stack

Ruby React Ruby on Rails Vite Bundler npm

GitHub topics

#bigquery #cdp #customer-data-platform #data-activation #data-engineering #data-pipeline

Updated: 2026-07-04
Lists: 2 list mentions
First commit: 2023-10-20
History: 4 history points
License: AGPL-3.0
Issues: 137 open

1,660

stars

Forks: 91
Commits: 1,870 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

wgzhao/Addax

A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly

AI dev

Stack

Java Maven

GitHub topics

#clickhouse #database #etl #excel #hadoop #hdfs

Updated: 2026-07-17
Lists: 1 list mention
First commit: 2018-01-18
History: 4 history points
License: Apache-2.0
Issues: 11 open

1,418

stars

Forks: 337
Commits: 2,010 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Open-Source-Legal/OpenContracts

The open document intelligence platform for builders and hackers - DMS for the agentic world

AI dev

Stack

Python Celery Django Django REST Framework pytest npm pip Yarn

GitHub topics

#agent #agentic-ai #ai #ai-agents #etl #etl-pipeline

Updated: 2026-07-16
Lists: 2 list mentions
First commit: 2022-10-24
History: 28 history points
License: MIT
Issues: 24 open

1,398

stars

Forks: 167
Commits: 12,492 commits
Star growth, last 7 days: +2 +0.1%
Commit velocity, last 7 days: +19 +0.2%

Website GitHub

amphi-ai/amphi-etl

visual data prep powered by python

AI dev

Stack

TypeScript pytest React Tornado npm PEP 517 pip

GitHub topics

#analytics-automation #data #data-analysis #data-pipelines #data-preparation #data-science

Updated: 2026-07-12
Lists: 0 list mentions
First commit: 2024-03-21
History: 46 history points
License: NOASSERTION
Issues: 129 open

1,367

stars

Forks: 103
Commits: 541 commits
Star growth, last 7 days: +3 +0.2%
Commit velocity, last 7 days: +5 +0.9%

Website GitHub

Open-Source-Legal/cite

Ground truth layer for humans and AI agents working together. Version control for knowledge.

AI dev

Stack

Python Celery Django Django REST Framework pytest npm pip Yarn

GitHub topics

#agent #agentic-ai #ai #ai-agents #etl #etl-pipeline

Updated: 2026-06-10
Lists: 2 list mentions
First commit: 2022-10-24
History: 11 history points
License: MIT
Issues: 14 open

1,344

stars

Forks: 153
Commits: 11,782 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

koopjs/koop

Transform, query, and download geospatial data on the web.

Stack

JavaScript Express npm

GitHub topics

#api #arcgis #arcgishub #data-management #etl #feature-service

Updated: 2026-04-04
Lists: 1 list mention
First commit: 2017-02-21
History: 5 history points
License: NOASSERTION
Issues: 61 open

708

stars

Forks: 135
Commits: 1,534 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

catalyst-cooperative/pudl

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

AI dev

Stack

Python PEP 517 pip

GitHub topics

#cems #climate #coal #ddj #eia #eia860

Updated: 2026-07-11
Lists: 1 list mention
First commit: 2016-09-20
History: 5 history points
License: MIT
Issues: 491 open

596

stars

Forks: 142
Commits: 11,112 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

smooks/smooks

An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration

Stack

Java Maven

GitHub topics

#analytics #chunking #enterprise-integration #etl #event-driven #java

Updated: 2025-11-24
Lists: 1 list mention
First commit: 2010-12-28
History: 5 history points
License: NOASSERTION
Issues: 35 open

416

stars

Forks: 356
Commits: 854 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing