Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 17,489
Awesome lists tracked: 126
Current results: 12

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

12 repos shown

Topic: data-integration

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-07-26
Lists: 5 list mentions
First commit: 2014-10-06
History: 71 history points
License: Apache-2.0
Issues: 1,801 open

46,253

stars

Forks: 17,457
Commits: 39,968 commits
Star growth, last 7 days: +69 +0.1%
Commit velocity, last 7 days: +166 +0.4%

Website GitHub

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

AI dev

Stack

Python Gradle npm PEP 517

GitHub topics

#bigquery #change-data-capture #data #data-analysis #data-collection #data-engineering

Updated: 2026-07-26
Lists: 2 list mentions
First commit: 2020-07-28
History: 89 history points
License: NOASSERTION
Issues: 2,225 open

21,706

stars

Forks: 5,277
Commits: 49,740 commits
Star growth, last 7 days: +44 +0.2%
Commit velocity, last 7 days: +414 +0.8%

Website GitHub

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev

Stack

Python FastAPI Flask LangChain Next.js npm PEP 517 pip

GitHub topics

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines

Updated: 2026-07-24
Lists: 4 list mentions
First commit: 2018-04-30
History: 10 history points
License: Apache-2.0
Issues: 2,597 open

15,895

stars

Forks: 2,220
Commits: 27,822 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack

Python LangChain Next.js pytest React npm PEP 517 pip

GitHub topics

#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science

Updated: 2026-07-02
Lists: 1 list mention
First commit: 2022-05-16
History: 5 history points
License: Apache-2.0
Issues: 617 open

8,769

stars

Forks: 978
Commits: 5,784 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

AI dev

Stack

Go Cobra gRPC Go pytest Go modules Gradle npm

GitHub topics

#airbyte #attack-surface-management #aws #azure #bigquery #cspm

Updated: 2026-07-25
Lists: 2 list mentions
First commit: 2020-11-18
History: 3 history points
License: MPL-2.0
Issues: 158 open

6,470

stars

Forks: 548
Commits: 22,360 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

apache/hudi

Upserts, Deletes And Incremental Processing on Big Data.

Stack

Java Jupyter Spring Boot Maven pip

GitHub topics

#apacheflink #apachehudi #apachespark #bigdata #data-integration #datalake

Updated: 2026-07-14
Lists: 1 list mention
First commit: 2016-12-16
History: 5 history points
License: Apache-2.0
Issues: 3,041 open

6,186

stars

Forks: 2,495
Commits: 7,605 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

fluvio-community/fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

Stack

Rust Cargo

GitHub topics

#cloud-native #data-analytics #data-flow #data-integration #data-pipelines #distributed-systems

Updated: 2026-07-16
Lists: 2 list mentions
First commit: 2019-09-04
History: 3 history points
License: Apache-2.0
Issues: 138 open

5,240

stars

Forks: 532
Commits: 2,574 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

clidey/whodb

Where data access meets operational intelligence

AI dev

Stack

Go Go modules npm PEP 517

GitHub topics

#ai-agent #data-catalog #data-governance #data-integration #data-lineage #data-pipeline

Updated: 2026-07-27
Lists: 3 list mentions
First commit: 2024-06-11
History: 39 history points
License: Apache-2.0
Issues: 10 open

4,935

stars

Forks: 224
Commits: 3,716 commits
Star growth, last 7 days: +4 +0.1%
Commit velocity, last 7 days: +39 +1.1%

Website GitHub

jitsucom/jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

AI dev

Stack

TypeScript Cobra Express Gin gRPC Go Go modules npm pnpm

GitHub topics

#bigquery #clickhouse #data-collection #data-connectors #data-integration #golang

Updated: 2026-07-24
Lists: 2 list mentions
First commit: 2022-06-22
History: 6 history points
License: MIT
Issues: 27 open

4,816

stars

Forks: 360
Commits: 3,257 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-07-24
Lists: 3 list mentions
First commit: 2019-07-19
History: 7 history points
License: NOASSERTION
Issues: 44 open

4,459

stars

Forks: 57
Commits: 6,611 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev

Stack

Go Go modules npm PEP 517

GitHub topics

#bigquery #copy-database #data-ingestion #data-integration #data-pipeline #duckdb

Updated: 2026-07-25
Lists: 1 list mention
First commit: 2024-02-12
History: 36 history points
License: NOASSERTION
Issues: 15 open

3,817

stars

Forks: 143
Commits: 3,066 commits
Star growth, last 7 days: +15 +0.4%
Commit velocity, last 7 days: +43 +1.4%

Website GitHub

mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Stack

Python pytest PEP 517 pip

GitHub topics

#data #data-integration #etl #pipeline #postgresql #python

Updated: 2023-12-15
Lists: 1 list mention
First commit: 2018-04-08
History: 65 history points
License: MIT
Issues: 26 open

2,089

stars

Forks: 100
Commits: 172 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing