Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 18,423
Awesome lists tracked: 132
Current results: 57

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

57 repos shown

Topic: data-engineering

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

apache/superset

Apache Superset is a Data Visualization and Data Exploration Platform

AI dev

Stack

Python Celery Express Flask pytest npm PEP 517 pip

GitHub topics

#analytics #apache #apache-superset #asf #bi #business-analytics

Updated: 2026-09-16
Lists: 5 list mentions
First commit: 2015-07-02
History: 120 history points
License: Apache-2.0
Issues: 650 open

74,784

stars

Forks: 18,308
Commits: 22,946 commits
Star growth, last 7 days: +84 +0.1%
Commit velocity, last 7 days: +113 +0.5%

Website GitHub

GokuMohandas/Made-With-ML

Learn how to develop, deploy and iterate on production-grade ML applications.

Stack

Jupyter Notebook FastAPI pytest PEP 517 pip

GitHub topics

#data-engineering #data-quality #data-science #deep-learning #distributed-ml #distributed-training

Updated: 2026-03-04
Lists: 1 list mention
First commit: 2023-07-26
History: 7 history points
License: MIT
Issues: 25 open

49,398

stars

Forks: 7,753
Commits: 19 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-09-16
Lists: 5 list mentions
First commit: 2014-10-06
History: 122 history points
License: Apache-2.0
Issues: 2,130 open

46,868

stars

Forks: 17,850
Commits: 41,131 commits
Star growth, last 7 days: +62 +0.1%
Commit velocity, last 7 days: +147 +0.4%

Website GitHub

kestra-io/kestra

Event Driven Orchestration & Scheduling Platform for Mission Critical Applications

AI dev

Stack

Java Micronaut React Vite Vue Gradle npm

GitHub topics

#ai-agents #automation #control-plane #data-engineering #data-orchestration #data-orchestrator

Updated: 2026-08-21
Lists: 3 list mentions
First commit: 2019-08-13
History: 8 history points
License: Apache-2.0
Issues: 689 open

27,880

stars

Forks: 2,931
Commits: 11,831 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

PrefectHQ/prefect

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

AI dev

Stack

Python FastAPI pytest React Starlette npm PEP 517 pip

GitHub topics

#automation #data #data-engineering #data-ops #data-science #infrastructure

Updated: 2026-09-15
Lists: 3 list mentions
First commit: 2021-07-12
History: 108 history points
License: Apache-2.0
Issues: 856 open

23,849

stars

Forks: 2,523
Commits: 22,066 commits
Star growth, last 7 days: +39 +0.2%
Commit velocity, last 7 days: +25 +0.1%

Website GitHub

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

AI dev

Stack

Python Micronaut pytest React Gradle pip pnpm

GitHub topics

#bigquery #change-data-capture #data #data-analysis #data-collection #data-engineering

Updated: 2026-09-16
Lists: 2 list mentions
First commit: 2020-07-28
History: 145 history points
License: NOASSERTION
Issues: 2,433 open

22,071

stars

Forks: 5,347
Commits: 52,465 commits
Star growth, last 7 days: +50 +0.2%
Commit velocity, last 7 days: +434 +0.8%

Website GitHub

argoproj/argo-workflows

Workflow Engine for Kubernetes

AI dev

Stack

Go Cobra Echo gRPC Go React Go modules Maven npm

GitHub topics

#airflow #argo #argo-workflows #batch-processing #cloud-native #cncf

Updated: 2026-08-08
Lists: 2 list mentions
First commit: 2017-10-17
History: 7 history points
License: Apache-2.0
Issues: 1,330 open

16,886

stars

Forks: 3,606
Commits: 6,633 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev

Stack

Python FastAPI Flask LangChain Next.js npm PEP 517 pip

GitHub topics

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines

Updated: 2026-08-22
Lists: 4 list mentions
First commit: 2018-04-30
History: 11 history points
License: Apache-2.0
Issues: 2,595 open

16,050

stars

Forks: 2,255
Commits: 27,882 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

andkret/Cookbook

The Data Engineering Cookbook

Stack

Python

GitHub topics

#best-practices #big-data #cookbook #data-engineer #data-engineering

Updated: 2026-07-23
Lists: 0 list mentions
First commit: 2019-03-10
History: 105 history points
License: Apache-2.0
Issues: 129 open

15,422

stars

Forks: 2,758
Commits: 407 commits
Star growth, last 7 days: +11 +0.1%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

semantica-agi/semantica

Graph-Native Infrastructure for Context and Accountable AI Systems

AI dev

Stack

Python Celery FastAPI Jupyter pytest npm PEP 517 pip

GitHub topics

#agent-memory #ai #ai-governance #ai-infrastructure #artificial-intelligence #context-engineering

Updated: 2026-09-15
Lists: 3 list mentions
First commit: 2025-06-25
History: 106 history points
License: MIT
Issues: 112 open

12,939

stars

Forks: 1,445
Commits: 2,946 commits
Star growth, last 7 days: +403 +3.2%
Commit velocity, last 7 days: +48 +1.7%

Website GitHub

fivetran/great_expectations

Always know what to expect from your data.

AI dev

Stack

Python pytest React npm PEP 517 pip

GitHub topics

#cleandata #data-engineering #data-profilers #data-profiling #data-quality #data-science

Updated: 2026-09-15
Lists: 0 list mentions
First commit: 2017-06-06
History: 58 history points
License: Apache-2.0
Issues: 41 open

11,795

stars

Forks: 1,846
Commits: 13,815 commits
Star growth, last 7 days: +17 +0.1%
Commit velocity, last 7 days: +12 +0.1%

Website GitHub

great-expectations/great_expectations

Always know what to expect from your data.

AI dev

Stack

Python pytest React npm PEP 517 pip

GitHub topics

#cleandata #data-engineering #data-profilers #data-profiling #data-quality #data-science

Updated: 2026-06-13
Lists: 2 list mentions
First commit: 2017-06-06
History: 5 history points
License: Apache-2.0
Issues: 50 open

11,556

stars

Forks: 1,760
Commits: 13,657 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

cocoindex-io/cocoindex

Incremental engine for long horizon agents 🌟 Star if you like it!

AI dev

Stack

Rust Astro Axum FastAPI pytest Cargo npm PEP 517

GitHub topics

#agentic-data-framework #ai #ai-agents #change-data-capture #codebase-intelligence #context-engineering

Updated: 2026-08-31
Lists: 2 list mentions
First commit: 2025-03-03
History: 1 history point
License: Apache-2.0
Issues: 76 open

11,461

stars

Forks: 894
Commits: 2,045 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

xonsh/xonsh

🐚 Python-powered shell. Full-featured, cross-platform and AI-friendly.

AI dev

Stack

Python pytest Tornado pip uv

GitHub topics

#anthropic #claude #claude-code #cmux #data-engineering #data-scientists

Updated: 2026-09-01
Lists: 3 list mentions
First commit: 2015-01-21
History: 8 history points
License: NOASSERTION
Issues: 74 open

9,628

stars

Forks: 735
Commits: 11,961 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack

Python LangChain Next.js pytest React npm PEP 517 pip

GitHub topics

#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science

Updated: 2026-09-10
Lists: 1 list mention
First commit: 2022-05-16
History: 7 history points
License: Apache-2.0
Issues: 624 open

8,821

stars

Forks: 990
Commits: 5,790 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

redpanda-data/connect

Fancy stream processing made operationally mundane

AI dev

Stack

Go Cobra Gin gRPC Go Starlette Go modules PEP 517 pip

GitHub topics

#amqp #cqrs #data-engineering #data-ops #etl #event-sourcing

Updated: 2026-08-25
Lists: 1 list mention
First commit: 2015-08-25
History: 4 history points
License: Unknown
Issues: 323 open

8,735

stars

Forks: 958
Commits: 7,582 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

growthbook/growthbook

Open Source Feature Flags, Experimentation, and Product Analytics

AI dev

Stack

TypeScript Express Jupyter Next.js pytest npm pip pnpm

GitHub topics

#ab-testing #abtest #abtesting #analytics #bigquery #clickhouse

Updated: 2026-08-21
Lists: 1 list mention
First commit: 2021-05-07
History: 4 history points
License: NOASSERTION
Issues: 891 open

8,144

stars

Forks: 814
Commits: 4,299 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

feast-dev/feast

The Open Source Feature Store for AI/ML

AI dev

Stack

Python Astro Cobra FastAPI gRPC Go Go modules Maven npm

GitHub topics

#big-data #data-engineering #data-quality #data-science #feature-store #features

Updated: 2026-09-16
Lists: 2 list mentions
First commit: 2018-12-10
History: 117 history points
License: Apache-2.0
Issues: 440 open

7,273

stars

Forks: 1,436
Commits: 4,727 commits
Star growth, last 7 days: +12 +0.2%
Commit velocity, last 7 days: +6 +0.1%

Website GitHub

Zipstack/unstract

LLM-Driven Extraction of Unstructured Data — Built for API Deployments & ETL Pipeline Workflows

AI dev

Stack

Python Celery Django Django REST Framework Flask Bun npm PEP 517

GitHub topics

#ai-agents #data-engineering #document-ai #generative-ai #idp #json-extraction

Updated: 2026-09-11
Lists: 1 list mention
First commit: 2024-02-21
History: 1 history point
License: AGPL-3.0
Issues: 95 open

7,234

stars

Forks: 715
Commits: 1,722 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

evidence-dev/evidence

Business intelligence as code: build fast, interactive data visualizations in SQL and markdown

AI dev

Stack

TypeScript Express Next.js React Svelte npm pnpm

GitHub topics

#analytics #business-intelligence #dashboard #data-engineering #data-science #data-visualization

Updated: 2026-08-21
Lists: 2 list mentions
First commit: 2021-05-27
History: 7 history points
License: MIT
Issues: 276 open

6,866

stars

Forks: 396
Commits: 9,963 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

AI dev

Stack

Go Cobra gRPC Go pytest Go modules Gradle npm

GitHub topics

#airbyte #attack-surface-management #aws #azure #bigquery #cspm

Updated: 2026-08-20
Lists: 2 list mentions
First commit: 2020-11-18
History: 4 history points
License: MPL-2.0
Issues: 165 open

6,487

stars

Forks: 552
Commits: 22,471 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

dlt-hub/dlt

data load tool (dlt) is an open source Python library that makes data loading easy 🛠️

AI dev

Stack

Python pytest React Streamlit npm PEP 517 pip

GitHub topics

#data #data-engineering #data-lake #data-loading #data-warehouse #elt

Updated: 2026-09-15
Lists: 1 list mention
First commit: 2022-05-16
History: 148 history points
License: Apache-2.0
Issues: 425 open

5,867

stars

Forks: 601
Commits: 4,471 commits
Star growth, last 7 days: +29 +0.5%
Commit velocity, last 7 days: +4 +0.1%

Website GitHub

Eventual-Inc/Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

AI dev

Stack

Rust Axum pytest Cargo CMake PEP 517

GitHub topics

#ai-engineering #ai-pipeline #arrow #artificial-intelligence #big-data #data-engineering

Updated: 2026-09-12
Lists: 0 list mentions
First commit: 2022-05-10
History: 42 history points
License: Apache-2.0
Issues: 394 open

5,756

stars

Forks: 555
Commits: 4,555 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

treeverse/lakeFS

lakeFS - Data version control for your data lake | Git for data

Stack

Go Android Cobra Gin gRPC Go Bundler Cargo Go modules

GitHub topics

#apache-spark #apache-sparksql #aws-s3 #azure-blob-storage #azure-storage #data-engineering

Updated: 2026-08-19
Lists: 1 list mention
First commit: 2019-09-12
History: 7 history points
License: Apache-2.0
Issues: 441 open

5,519

stars

Forks: 475
Commits: 6,557 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

ruc-datalab/DeepAnalyze

DeepAnalyze is the first agentic LLM for autonomous data science. 🎈你的AI数据分析师，自动分析大量数据，一键生成专业分析报告！

Stack

Python FastAPI Gradio Jupyter Next.js npm PEP 517 pip

GitHub topics

#agent #agentic #agentic-ai #ai #ai-scientist #chatbot

Updated: 2026-08-30
Lists: 2 list mentions
First commit: 2025-10-11
History: 7 history points
License: MIT
Issues: 24 open

4,589

stars

Forks: 728
Commits: 295 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-08-21
Lists: 3 list mentions
First commit: 2019-07-19
History: 8 history points
License: NOASSERTION
Issues: 53 open

4,475

stars

Forks: 60
Commits: 6,638 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

aws/aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

Stack

Python pytest PEP 517 pip uv

GitHub topics

#amazon-athena #amazon-sagemaker-notebook #apache-arrow #apache-parquet #athena #aws

Updated: 2026-09-08
Lists: 1 list mention
First commit: 2019-02-26
History: 10 history points
License: Apache-2.0
Issues: 57 open

4,119

stars

Forks: 747
Commits: 2,805 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Netflix/maestro

Maestro: Netflix’s Workflow Orchestrator

Stack

Java Spring Boot Gradle

GitHub topics

#agentic-workflow #analytics #automation #batch-processing #dag #data-engineering

Updated: 2026-09-03
Lists: 1 list mention
First commit: 2024-04-17
History: 7 history points
License: Apache-2.0
Issues: 58 open

3,834

stars

Forks: 311
Commits: 173 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

ploomber/ploomber

The fastest ⚡️ way to build data pipelines. Develop iteratively, deploy anywhere. ☁️

Archived

Stack

Python PEP 517 pip

GitHub topics

#data-engineering #data-science #jupyter #jupyter-notebooks #machine-learning #mlops

Updated: 2025-05-29
Lists: 1 list mention
First commit: 2020-01-20
History: 4 history points
License: Apache-2.0
Issues: 110 open

3,622

stars

Forks: 244
Commits: 3,061 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

lakehq/sail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

AI dev

Stack

Rust Axum pytest React Tailwind CSS Cargo PEP 517 pnpm

GitHub topics

#apache-iceberg #apache-spark #arrow #artificial-intelligence #big-data #data-engineering

Updated: 2026-09-15
Lists: 1 list mention
First commit: 2023-12-21
History: 80 history points
License: Apache-2.0
Issues: 268 open

3,374

stars

Forks: 218
Commits: 1,633 commits
Star growth, last 7 days: +9 +0.3%
Commit velocity, last 7 days: +6 +0.4%

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing