Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 17,373
Awesome lists tracked: 125
Current results: 12

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

12 repos shown

Topic: data-integration

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-07-17
Lists: 5 list mentions
First commit: 2014-10-06
History: 62 history points
License: Apache-2.0
Issues: 1,739 open

46,152

stars

Forks: 17,393
Commits: 39,742 commits
Star growth, last 7 days: +61 +0.1%
Commit velocity, last 7 days: +101 +0.3%

Website GitHub

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

AI dev

Stack

Python Gradle npm PEP 517

GitHub topics

#bigquery #change-data-capture #data #data-analysis #data-collection #data-engineering

Updated: 2026-07-16
Lists: 2 list mentions
First commit: 2020-07-28
History: 69 history points
License: NOASSERTION
Issues: 2,504 open

21,638

stars

Forks: 5,255
Commits: 49,318 commits
Star growth, last 7 days: +33 +0.2%
Commit velocity, last 7 days: +405 +0.8%

Website GitHub

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev

Stack

Python FastAPI Flask LangChain Next.js npm PEP 517 pip

GitHub topics

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines

Updated: 2026-07-06
Lists: 4 list mentions
First commit: 2018-04-30
History: 9 history points
License: Apache-2.0
Issues: 2,568 open

15,795

stars

Forks: 2,184
Commits: 27,770 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack

Python LangChain Next.js pytest React npm PEP 517 pip

GitHub topics

#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science

Updated: 2026-07-02
Lists: 1 list mention
First commit: 2022-05-16
History: 5 history points
License: Apache-2.0
Issues: 617 open

8,769

stars

Forks: 978
Commits: 5,784 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

AI dev

Stack

Go Cobra gRPC Go pytest Go modules Gradle npm

GitHub topics

#airbyte #attack-surface-management #aws #azure #bigquery #cspm

Updated: 2026-07-06
Lists: 2 list mentions
First commit: 2020-11-18
History: 2 history points
License: MPL-2.0
Issues: 155 open

6,453

stars

Forks: 550
Commits: 22,287 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/hudi

Upserts, Deletes And Incremental Processing on Big Data.

Stack

Java Jupyter Spring Boot Maven pip

GitHub topics

#apacheflink #apachehudi #apachespark #bigdata #data-integration #datalake

Updated: 2026-07-14
Lists: 1 list mention
First commit: 2016-12-16
History: 5 history points
License: Apache-2.0
Issues: 3,041 open

6,186

stars

Forks: 2,495
Commits: 7,605 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

fluvio-community/fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

Stack

Rust Cargo

GitHub topics

#cloud-native #data-analytics #data-flow #data-integration #data-pipelines #distributed-systems

Updated: 2026-06-23
Lists: 2 list mentions
First commit: 2019-09-04
History: 2 history points
License: Apache-2.0
Issues: 140 open

5,239

stars

Forks: 529
Commits: 2,574 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

clidey/whodb

Where data access meets operational intelligence

AI dev

Stack

Go Go modules npm PEP 517

GitHub topics

#ai-agent #data-catalog #data-governance #data-integration #data-lineage #data-pipeline

Updated: 2026-07-17
Lists: 3 list mentions
First commit: 2024-06-11
History: 29 history points
License: Apache-2.0
Issues: 20 open

4,928

stars

Forks: 221
Commits: 3,646 commits
Star growth, last 7 days: +5 +0.1%
Commit velocity, last 7 days: +40 +1.1%

Website GitHub

jitsucom/jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

AI dev

Stack

TypeScript Cobra Express Gin gRPC Go Go modules npm pnpm

GitHub topics

#bigquery #clickhouse #data-collection #data-connectors #data-integration #golang

Updated: 2026-07-06
Lists: 2 list mentions
First commit: 2022-06-22
History: 5 history points
License: MIT
Issues: 27 open

4,793

stars

Forks: 356
Commits: 3,109 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Cobra Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-07-06
Lists: 3 list mentions
First commit: 2019-07-19
History: 6 history points
License: NOASSERTION
Issues: 36 open

4,452

stars

Forks: 53
Commits: 6,582 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev

Stack

Go Go modules npm PEP 517

GitHub topics

#bigquery #copy-database #data-ingestion #data-integration #data-pipeline #duckdb

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2024-02-12
History: 26 history points
License: NOASSERTION
Issues: 22 open

3,781

stars

Forks: 143
Commits: 2,987 commits
Star growth, last 7 days: +23 +0.6%
Commit velocity, last 7 days: +46 +1.6%

Website GitHub

mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Stack

Python pytest PEP 517 pip

GitHub topics

#data #data-integration #etl #pipeline #postgresql #python

Updated: 2023-12-15
Lists: 1 list mention
First commit: 2018-04-08
History: 56 history points
License: MIT
Issues: 26 open

2,089

stars

Forks: 100
Commits: 172 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing