Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 17,489
Awesome lists tracked: 126
Current results: 27

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

27 repos shown

Topic: etl

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

pathwaycom/pathway

Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.

Stack

Python Axum FastAPI LangChain pytest Cargo npm PEP 517

GitHub topics

#batch-processing #data-analytics #data-pipelines #data-processing #dataflow #etl

Updated: 2026-07-14
Lists: 3 list mentions
First commit: 2023-07-21
History: 8 history points
License: NOASSERTION
Issues: 35 open

62,661

stars

Forks: 1,668
Commits: 2,118 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-07-26
Lists: 5 list mentions
First commit: 2014-10-06
History: 71 history points
License: Apache-2.0
Issues: 1,801 open

46,253

stars

Forks: 17,457
Commits: 39,968 commits
Star growth, last 7 days: +69 +0.1%
Commit velocity, last 7 days: +166 +0.4%

Website GitHub

kestra-io/kestra

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

AI dev

Stack

Java Micronaut React Vite Vue Gradle npm

GitHub topics

#ai-agents #automation #control-plane #data-engineering #data-orchestration #data-orchestrator

Updated: 2026-07-24
Lists: 3 list mentions
First commit: 2019-08-13
History: 7 history points
License: Apache-2.0
Issues: 538 open

27,457

stars

Forks: 2,755
Commits: 11,426 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

vectordotdev/vector

A high-performance observability data pipeline.

AI dev

Stack

Rust Axum React Tailwind CSS Warp Cargo npm pip

GitHub topics

#agent #cloud-native #data-transformation #datadog #etl #events

Updated: 2026-07-16
Lists: 3 list mentions
First commit: 2018-09-13
History: 4 history points
License: MPL-2.0
Issues: 2,488 open

22,187

stars

Forks: 2,205
Commits: 13,926 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

AI dev

Stack

Python Gradle npm PEP 517

GitHub topics

#bigquery #change-data-capture #data #data-analysis #data-collection #data-engineering

Updated: 2026-07-26
Lists: 2 list mentions
First commit: 2020-07-28
History: 89 history points
License: NOASSERTION
Issues: 2,225 open

21,706

stars

Forks: 5,277
Commits: 49,740 commits
Star growth, last 7 days: +44 +0.2%
Commit velocity, last 7 days: +414 +0.8%

Website GitHub

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev

Stack

Python FastAPI Flask LangChain Next.js npm PEP 517 pip

GitHub topics

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines

Updated: 2026-07-24
Lists: 4 list mentions
First commit: 2018-04-30
History: 10 history points
License: Apache-2.0
Issues: 2,597 open

15,895

stars

Forks: 2,220
Commits: 27,822 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack

Python LangChain Next.js pytest React npm PEP 517 pip

GitHub topics

#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science

Updated: 2026-07-02
Lists: 1 list mention
First commit: 2022-05-16
History: 5 history points
License: Apache-2.0
Issues: 617 open

8,769

stars

Forks: 978
Commits: 5,784 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

redpanda-data/connect

Fancy stream processing made operationally mundane

AI dev

Stack

Go Cobra Gin gRPC Go Starlette Go modules PEP 517 pip

GitHub topics

#amqp #cqrs #data-engineering #data-ops #etl #event-sourcing

Updated: 2026-07-24
Lists: 1 list mention
First commit: 2015-08-25
History: 3 history points
License: Unknown
Issues: 296 open

8,713

stars

Forks: 952
Commits: 7,539 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

AI dev

Stack

Go Cobra gRPC Go pytest Go modules Gradle npm

GitHub topics

#airbyte #attack-surface-management #aws #azure #bigquery #cspm

Updated: 2026-07-25
Lists: 2 list mentions
First commit: 2020-11-18
History: 3 history points
License: MPL-2.0
Issues: 158 open

6,470

stars

Forks: 548
Commits: 22,360 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Eventual-Inc/Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

AI dev

Stack

Rust Cargo CMake PEP 517

GitHub topics

#ai-engineering #ai-pipeline #arrow #artificial-intelligence #big-data #data-engineering

Updated: 2026-07-24
Lists: 0 list mentions
First commit: 2022-05-10
History: 34 history points
License: Apache-2.0
Issues: 339 open

5,663

stars

Forks: 529
Commits: 4,506 commits
Star growth, last 7 days: +17 +0.3%
Commit velocity, last 7 days: +12 +0.3%

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-07-24
Lists: 3 list mentions
First commit: 2019-07-19
History: 7 history points
License: NOASSERTION
Issues: 44 open

4,459

stars

Forks: 57
Commits: 6,611 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

orchest/orchest

Build data pipelines, the easy way 🛠️

Archived

Stack

TypeScript Celery Cobra Flask gRPC Go Go modules npm PEP 517

GitHub topics

#airflow #cloud #dag #data-pipelines #data-science #deployment

Updated: 2023-06-06
Lists: 1 list mention
First commit: 2019-11-28
History: 3 history points
License: Apache-2.0
Issues: 130 open

4,135

stars

Forks: 262
Commits: 9,688 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

aws/aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Stack

Python pytest PEP 517 pip uv

GitHub topics

#amazon-athena #amazon-sagemaker-notebook #apache-arrow #apache-parquet #athena #aws

Updated: 2026-07-14
Lists: 1 list mention
First commit: 2019-02-26
History: 8 history points
License: Apache-2.0
Issues: 48 open

4,117

stars

Forks: 736
Commits: 2,769 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

ucbepic/docetl

A system for agentic LLM-powered data processing and ETL

AI dev

Stack

Python FastAPI Next.js pytest React npm pip uv

GitHub topics

#agents #data #data-pipelines #document-analysis #document-processing #elt

Updated: 2026-07-21
Lists: 1 list mention
First commit: 2024-07-09
History: 58 history points
License: MIT
Issues: 44 open

3,948

stars

Forks: 419
Commits: 915 commits
Star growth, last 7 days: +45 +1.2%
Commit velocity, last 7 days: +1 +0.1%

Website GitHub

Netflix/maestro

Maestro: Netflix’s Workflow Orchestrator

Stack

Java Spring Boot Gradle

GitHub topics

#agentic-workflow #analytics #automation #batch-processing #dag #data-engineering

Updated: 2026-07-15
Lists: 1 list mention
First commit: 2024-04-17
History: 5 history points
License: Apache-2.0
Issues: 35 open

3,800

stars

Forks: 296
Commits: 164 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

SQLMesh/sqlmesh

Scalable and efficient data transformation framework - backwards compatible with dbt.

AI dev

Stack

Python npm PEP 517 pip

GitHub topics

#dataengineering #dataops #dbt #elt #etl #python

Updated: 2026-07-26
Lists: 1 list mention
First commit: 2022-09-23
History: 35 history points
License: Apache-2.0
Issues: 262 open

3,223

stars

Forks: 416
Commits: 4,648 commits
Star growth, last 7 days: +13 +0.4%
Commit velocity, last 7 days: +7 +0.2%

Website GitHub

apache/hamilton

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere python does.

Stack

Jupyter Notebook Django FastAPI Jupyter LangChain npm PEP 517 pip

GitHub topics

#dag #data-analysis #data-engineering #data-science #dataframe #etl

Updated: 2026-07-13
Lists: 2 list mentions
First commit: 2019-07-25
History: 7 history points
License: Apache-2.0
Issues: 154 open

2,545

stars

Forks: 198
Commits: 2,038 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Stack

Python pytest PEP 517 pip

GitHub topics

#data #data-integration #etl #pipeline #postgresql #python

Updated: 2023-12-15
Lists: 1 list mention
First commit: 2018-04-08
History: 65 history points
License: MIT
Issues: 26 open

2,089

stars

Forks: 100
Commits: 172 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

Multiwoven/multiwoven

🔥🔥🔥 Open source Reverse ETL - alternative to hightouch and census.

Stack

Ruby React Ruby on Rails Vite Bundler npm

GitHub topics

#bigquery #cdp #customer-data-platform #data-activation #data-engineering #data-pipeline

Updated: 2026-07-24
Lists: 2 list mentions
First commit: 2023-10-20
History: 5 history points
License: AGPL-3.0
Issues: 150 open

1,664

stars

Forks: 92
Commits: 1,873 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

wgzhao/Addax

A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly

AI dev

Stack

Java Maven

GitHub topics

#clickhouse #database #etl #excel #hadoop #hdfs

Updated: 2026-07-17
Lists: 1 list mention
First commit: 2018-01-18
History: 4 history points
License: Apache-2.0
Issues: 11 open

1,418

stars

Forks: 337
Commits: 2,010 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

Open-Source-Legal/OpenContracts

The open document intelligence platform for builders and hackers - DMS for the agentic world

AI dev

Stack

Python Celery Django Django REST Framework pytest npm pip Yarn

GitHub topics

#agent #agentic-ai #ai #ai-agents #etl #etl-pipeline

Updated: 2026-07-26
Lists: 2 list mentions
First commit: 2022-10-24
History: 38 history points
License: MIT
Issues: 9 open

1,408

stars

Forks: 171
Commits: 12,557 commits
Star growth, last 7 days: +6 +0.4%
Commit velocity, last 7 days: +29 +0.2%

Website GitHub

amphi-ai/amphi-etl

visual data prep powered by python

AI dev

Stack

TypeScript pytest React Tornado npm PEP 517 pip

GitHub topics

#analytics-automation #data #data-analysis #data-pipelines #data-preparation #data-science

Updated: 2026-07-23
Lists: 0 list mentions
First commit: 2024-03-21
History: 56 history points
License: NOASSERTION
Issues: 127 open

1,367

stars

Forks: 103
Commits: 545 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: +4 +0.7%

Website GitHub

Open-Source-Legal/cite

Ground truth layer for humans and AI agents working together. Version control for knowledge.

AI dev

Stack

Python Celery Django Django REST Framework pytest npm pip Yarn

GitHub topics

#agent #agentic-ai #ai #ai-agents #etl #etl-pipeline

Updated: 2026-06-10
Lists: 2 list mentions
First commit: 2022-10-24
History: 11 history points
License: MIT
Issues: 14 open

1,344

stars

Forks: 153
Commits: 11,782 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

koopjs/koop

Transform, query, and download geospatial data on the web.

Stack

JavaScript Express npm

GitHub topics

#api #arcgis #arcgishub #data-management #etl #feature-service

Updated: 2026-04-04
Lists: 1 list mention
First commit: 2017-02-21
History: 5 history points
License: NOASSERTION
Issues: 61 open

708

stars

Forks: 135
Commits: 1,534 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

catalyst-cooperative/pudl

The Public Utility Data Liberation Project provides analysis-ready energy system data to climate advocates, researchers, policymakers, and journalists.

AI dev

Stack

Python PEP 517 pip

GitHub topics

#cems #climate #coal #ddj #eia #eia860

Updated: 2026-07-11
Lists: 1 list mention
First commit: 2016-09-20
History: 5 history points
License: MIT
Issues: 491 open

596

stars

Forks: 142
Commits: 11,112 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

smooks/smooks

An extensible Java framework for building event-driven applications that break up XML and non-XML data into chunks for data integration

Stack

Java Maven

GitHub topics

#analytics #chunking #enterprise-integration #etl #event-driven #java

Updated: 2025-11-24
Lists: 1 list mention
First commit: 2010-12-28
History: 5 history points
License: NOASSERTION
Issues: 35 open

416

stars

Forks: 356
Commits: 854 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

Edward-K1/validatedata

An easier way to validate data in python

Stack

Python pytest PEP 517 pip uv

GitHub topics

#data #data-engineering #datascience #decorators-python #django #django-rest-framework

Updated: 2026-07-24
Lists: 0 list mentions
First commit: 2021-09-07
History: 36 history points
License: MIT
Issues: 0 open

stars

Forks: 1
Commits: 59 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: +2 +3.5%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing