Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 18,423
Awesome lists tracked: 132
Current results: 14

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

14 repos shown

Topic: data-integration

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-09-16
Lists: 5 list mentions
First commit: 2014-10-06
History: 122 history points
License: Apache-2.0
Issues: 2,130 open

46,868

stars

Forks: 17,850
Commits: 41,131 commits
Star growth, last 7 days: +62 +0.1%
Commit velocity, last 7 days: +147 +0.4%

Website GitHub

airbytehq/airbyte

Open-source data movement for ELT pipelines and AI agents — from APIs, databases & files to warehouses, lakes, and AI applications. Both self-hosted and Cloud.

AI dev

Stack

Python Micronaut pytest React Gradle pip pnpm

GitHub topics

#bigquery #change-data-capture #data #data-analysis #data-collection #data-engineering

Updated: 2026-09-16
Lists: 2 list mentions
First commit: 2020-07-28
History: 145 history points
License: NOASSERTION
Issues: 2,433 open

22,071

stars

Forks: 5,347
Commits: 52,465 commits
Star growth, last 7 days: +50 +0.2%
Commit velocity, last 7 days: +434 +0.8%

Website GitHub

dagster-io/dagster

An orchestration platform for the development, production, and observation of data assets.

AI dev

Stack

Python FastAPI Flask LangChain Next.js npm PEP 517 pip

GitHub topics

#analytics #dagster #data-engineering #data-integration #data-orchestrator #data-pipelines

Updated: 2026-08-22
Lists: 4 list mentions
First commit: 2018-04-30
History: 11 history points
License: Apache-2.0
Issues: 2,595 open

16,050

stars

Forks: 2,255
Commits: 27,882 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/seatunnel

SeaTunnel is a multimodal, high-performance, distributed, massive data integration tool.

AI dev

Stack

Java pytest Maven PEP 517

GitHub topics

#apache #batch #cdc #change-data-capture #data-ingestion #data-integration

Updated: 2026-09-04
Lists: 1 list mention
First commit: 2017-08-05
History: 1 history point
License: Apache-2.0
Issues: 677 open

9,615

stars

Forks: 2,385
Commits: 6,123 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

mage-ai/mage-ai

🧙 Build, run, and manage data pipelines for integrating and transforming data.

Stack

Python LangChain Next.js pytest React npm PEP 517 pip

GitHub topics

#artificial-intelligence #data #data-engineering #data-integration #data-pipelines #data-science

Updated: 2026-09-10
Lists: 1 list mention
First commit: 2022-05-16
History: 7 history points
License: Apache-2.0
Issues: 624 open

8,821

stars

Forks: 990
Commits: 5,790 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

cloudquery/cloudquery

Data pipelines for cloud config and security data. Build cloud asset inventory, CSPM, FinOps, and vulnerability management solutions. Extract from AWS, Azure, GCP, and 70+ cloud and SaaS sources.

AI dev

Stack

Go Cobra gRPC Go pytest Go modules Gradle npm

GitHub topics

#airbyte #attack-surface-management #aws #azure #bigquery #cspm

Updated: 2026-08-20
Lists: 2 list mentions
First commit: 2020-11-18
History: 4 history points
License: MPL-2.0
Issues: 165 open

6,487

stars

Forks: 552
Commits: 22,471 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/hudi

Upserts, Deletes And Incremental Processing on Big Data.

Stack

Java FastAPI Jupyter pytest Spring Boot Maven PEP 517 pip

GitHub topics

#apacheflink #apachehudi #apachespark #bigdata #data-integration #datalake

Updated: 2026-09-07
Lists: 1 list mention
First commit: 2016-12-16
History: 7 history points
License: Apache-2.0
Issues: 2,850 open

6,236

stars

Forks: 2,515
Commits: 7,859 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

fluvio-community/fluvio

🦀 event stream processing for developers to collect and transform data in motion to power responsive data intensive applications.

Stack

Rust Cargo

GitHub topics

#cloud-native #data-analytics #data-flow #data-integration #data-pipelines #distributed-systems

Updated: 2026-08-11
Lists: 2 list mentions
First commit: 2019-09-04
History: 4 history points
License: Apache-2.0
Issues: 140 open

5,244

stars

Forks: 531
Commits: 2,574 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

jitsucom/jitsu

Jitsu is an open-source Segment alternative. Fully-scriptable data ingestion engine for modern data teams. Set-up a real-time data pipeline in minutes, not days

AI dev

Stack

TypeScript Cobra Express Gin gRPC Go Go modules npm pnpm

GitHub topics

#bigquery #clickhouse #data-collection #data-connectors #data-integration #golang

Updated: 2026-08-21
Lists: 2 list mentions
First commit: 2022-06-22
History: 7 history points
License: MIT
Issues: 32 open

5,038

stars

Forks: 395
Commits: 3,501 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

clidey/whodb

Where data access meets operational intelligence

AI dev

Stack

Go Cobra Express gRPC Go React Go modules npm PEP 517

GitHub topics

#ai-agent #data-catalog #data-governance #data-integration #data-lineage #data-pipeline

Updated: 2026-08-11
Lists: 3 list mentions
First commit: 2024-06-11
History: 47 history points
License: Apache-2.0
Issues: 20 open

5,000

stars

Forks: 237
Commits: 3,814 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-08-21
Lists: 3 list mentions
First commit: 2019-07-19
History: 8 history points
License: NOASSERTION
Issues: 53 open

4,475

stars

Forks: 60
Commits: 6,638 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev

Stack

Go Cobra gRPC Go Vite Vue Go modules npm PEP 517

GitHub topics

#bigquery #copy-database #data-ingestion #data-integration #data-pipeline #duckdb

Updated: 2026-09-11
Lists: 2 list mentions
First commit: 2024-02-12
History: 44 history points
License: NOASSERTION
Issues: 19 open

3,956

stars

Forks: 152
Commits: 3,429 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Stack

Python pytest PEP 517 pip

GitHub topics

#data #data-integration #etl #pipeline #postgresql #python

Updated: 2023-12-15
Lists: 1 list mention
First commit: 2018-04-08
History: 116 history points
License: MIT
Issues: 26 open

2,091

stars

Forks: 99
Commits: 172 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

slothflowlabs/duckle

Open-source ETL/ELT you deploy on your own servers or cloud. Built on DuckDB: no-code/low-code visual pipelines or SQL, 385 components, dbt, CDC, data quality, reverse ETL, lineage, MCP for AI agents. No vendor cloud, no per-row billing.

Stack

Rust Axum React Tauri Vite Cargo npm PEP 517

GitHub topics

#cdc #connectors #data-engineering #data-integration #data-orchestration #data-pipeline

Updated: 2026-09-08
Lists: 2 list mentions
First commit: 2026-05-21
History: 3 history points
License: Apache-2.0
Issues: 57 open

1,281

stars

Forks: 97
Commits: 1,495 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing