Awesome

GitHub projects from awesome lists

Search awesome repositories

Search names, descriptions, topics, tags, and stacks, then tune results by ecosystem, freshness, health, and cross-list signal.

Continue with GitHub Browse awesome lists Request a list

Repos indexed: 17,758
Awesome lists tracked: 131
Current results: 186

Find repositories

Start broad, then narrow by ecosystem, freshness, health, and growth.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Awesome list

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

186 repos shown

List: awesome-bigdata

Browse

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev

Stack

Go Go modules npm PEP 517

GitHub topics

#bigquery #copy-database #data-ingestion #data-integration #data-pipeline #duckdb

Updated: 2026-08-02
Lists: 2 list mentions
First commit: 2024-02-12
History: 43 history points
License: NOASSERTION
Issues: 10 open

3,829

stars

Forks: 144
Commits: 3,101 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

polyaxon/polyaxon

AI Infra / AI Orchestration / AI Control Plane

Stack

MDX

GitHub topics

#agents #artificial-intelligence #data-science #deep-learning #harness #hyperparameter-optimization

Updated: 2026-07-15
Lists: 4 list mentions
First commit: 2016-03-25
History: 7 history points
License: Apache-2.0
Issues: 125 open

3,717

stars

Forks: 328
Commits: 10,391 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

tarantool/tarantool

Get your data in RAM. Get compute close to data. Enjoy the performance.

AI dev

Stack

Lua CMake pip

GitHub topics

#appserver #database #disk #in-memory #lua #msgpack

Updated: 2026-07-31
Lists: 1 list mention
First commit: 2010-08-12
History: 6 history points
License: NOASSERTION
Issues: 1,672 open

3,657

stars

Forks: 414
Commits: 19,979 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/incubator-heron

Apache Heron (Incubating) is a realtime, distributed, fault-tolerant stream processing engine from Twitter

Archived

Stack

Java npm pip

GitHub topics

#heron #messaging #streaming

Updated: 2023-03-01
Lists: 1 list mention
First commit: 2015-12-19
History: 95 history points
License: Apache-2.0
Issues: 409 open

3,628

stars

Forks: 581
Commits: 3,308 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Netflix/atlas

In-memory dimensional time series database.

AI dev

Stack

Scala Vite npm

Updated: 2026-07-28
Lists: 1 list mention
First commit: 2014-08-05
History: 6 history points
License: Apache-2.0
Issues: 7 open

3,559

stars

Forks: 355
Commits: 2,982 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

ml-tooling/ml-workspace

🛠 All-in-one web-based IDE specialized for machine learning and data science.

Stack

Jupyter Notebook FastAPI Flask .NET SDK pip

GitHub topics

#anaconda #data-analysis #data-science #data-visualization #deep-learning #docker

Updated: 2024-07-26
Lists: 3 list mentions
First commit: 2019-05-27
History: 7 history points
License: Apache-2.0
Issues: 0 open

3,543

stars

Forks: 458
Commits: 847 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

twitter/scalding

A Scala API for Cascading

Stack

Scala

Updated: 2023-05-28
Lists: 2 list mentions
First commit: 2012-01-10
History: 6 history points
License: Apache-2.0
Issues: 317 open

3,522

stars

Forks: 699
Commits: 4,195 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

Stack

Java Spring Boot Vite Vue Maven npm

GitHub topics

#application-manager #context-service #engine #hive #hive-table #impala

Updated: 2026-08-19
Lists: 1 list mention
First commit: 2019-07-23
History: 95 history points
License: Apache-2.0
Issues: 174 open

3,406

stars

Forks: 1,168
Commits: 4,342 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

mozilla-services/heka

DEPRECATED: Data collection and processing made easy.

Archived

Stack

Go CMake

Updated: 2024-01-23
Lists: 1 list mention
First commit: 2012-10-10
History: 6 history points
License: NOASSERTION
Issues: 232 open

3,399

stars

Forks: 517
Commits: 4,118 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

WeBankFinTech/DataSphereStudio

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Stack

Java Spring Boot Vite Vue Maven npm

GitHub topics

#airflow #atlas #azkaban #dataworks #davinci #dolphinscheduler

Updated: 2025-11-04
Lists: 1 list mention
First commit: 2019-11-24
History: 6 history points
License: Apache-2.0
Issues: 360 open

3,265

stars

Forks: 1,037
Commits: 12,523 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

facebookarchive/beringei

Beringei is a high performance, in-memory storage engine for time series data.

Archived

Stack

C++ CMake

Updated: 2018-07-11
Lists: 1 list mention
First commit: 2016-11-18
History: 96 history points
License: NOASSERTION
Issues: Disabled

3,152

stars

Forks: 286
Commits: 182 commits
Star growth, last 7 days: -1 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

benedekrozemberczki/pytorch_geometric_temporal

PyTorch Geometric Temporal: Spatiotemporal Signal Processing with Neural Machine Learning Models (CIKM 2021)

Stack

Python pip

GitHub topics

#deep-learning #gcn #gnn #graph-convolution #graph-convolutional-networks #graph-embedding

Updated: 2026-05-30
Lists: 3 list mentions
First commit: 2020-06-27
History: 8 history points
License: MIT
Issues: 30 open

2,993

stars

Forks: 405
Commits: 2,062 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

chdb-io/chdb

chDB is an in-process OLAP SQL Engine 🚀 powered by ClickHouse

AI dev

Stack

Python pytest PEP 517 pip

GitHub topics

#chdb #clickhouse #clickhouse-database #clickhouse-server #data-science #database

Updated: 2026-07-29
Lists: 2 list mentions
First commit: 2008-12-01
History: 5 history points
License: Apache-2.0
Issues: 38 open

2,852

stars

Forks: 127
Commits: 3,368 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

baidu/bfs

The Baidu File System.

Stack

C++

Updated: 2018-12-03
Lists: 1 list mention
First commit: 2014-11-13
History: 6 history points
License: BSD-3-Clause
Issues: 119 open

2,846

stars

Forks: 552
Commits: 2,139 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

numaproj/numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

Stack

Rust Axum Cobra Gin gRPC Go Cargo Go modules npm

GitHub topics

#data-processing #hacktoberfest #k8s #kubernetes #map-reduce #pipeline

Updated: 2026-07-31
Lists: 1 list mention
First commit: 2022-05-20
History: 6 history points
License: Apache-2.0
Issues: 293 open

2,819

stars

Forks: 167
Commits: 1,850 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

airbnb/airpal

Web UI for PrestoDB.

Archived

Stack

Java React Gradle npm

Updated: 2021-05-20
Lists: 1 list mention
First commit: 2014-05-07
History: 6 history points
License: Apache-2.0
Issues: 87 open

2,745

stars

Forks: 444
Commits: 448 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

samizdatco/arbor

a graph visualization library using web workers and jQuery

Stack

JavaScript

Updated: 2020-04-10
Lists: 2 list mentions
First commit: 2011-01-12
History: 6 history points
License: Unknown
Issues: 56 open

2,661

stars

Forks: 623
Commits: 12 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

FeatureBaseDB/featurebase

A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase

Archived

Stack

Go Cobra Echo Gin gRPC Go Go modules npm Yarn

GitHub topics

#big-data #bitmap #database #go #index #pilosa

Updated: 2024-02-21
Lists: 1 list mention
First commit: 2013-10-16
History: 94 history points
License: Apache-2.0
Issues: 7 open

2,521

stars

Forks: 239
Commits: 5,576 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

griddb/griddb

GridDB is a next-generation open source database that makes time series IoT and big data fast,and easy.

Stack

C++ CMake .NET SDK Maven

GitHub topics

#bigdata #database #fast #griddb #iot #newsql

Updated: 2026-03-19
Lists: 1 list mention
First commit: 2016-02-24
History: 96 history points
License: AGPL-3.0
Issues: 51 open

2,475

stars

Forks: 4,971
Commits: 500 commits
Star growth, last 7 days: -1 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

influxdata/kapacitor

Open source framework for processing, monitoring, and alerting on time series data

AI dev

Stack

Go Cobra gRPC Go Go modules pip

GitHub topics

#kapacitor #monitoring #time-series

Updated: 2026-07-25
Lists: 1 list mention
First commit: 2015-08-31
History: 6 history points
License: MIT
Issues: 837 open

2,373

stars

Forks: 478
Commits: 2,056 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

datopian/portaljs

🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless).

AI dev

Stack

TypeScript Express Next.js React Tailwind CSS npm Yarn

GitHub topics

#agent-skills #ai #ai-agents #ckan #claude-code #data-mesh

Updated: 2026-08-25
Lists: 1 list mention
First commit: 2011-03-09
History: 94 history points
License: MIT
Issues: 73 open

2,344

stars

Forks: 334
Commits: 3,497 commits
Star growth, last 7 days: +2 +0.1%
Commit velocity, last 7 days: +4 +0.1%

Website GitHub

benedekrozemberczki/karateclub

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

Stack

Python pip

GitHub topics

#2vec #community-detection #deepwalk #gcn #graph-clustering #graph-embedding

Updated: 2024-07-17
Lists: 3 list mentions
First commit: 2019-12-05
History: 8 history points
License: GPL-3.0
Issues: 12 open

2,285

stars

Forks: 255
Commits: 2,319 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/gobblin

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

Stack

Java Gradle pip

GitHub topics

#apache #data #ingestion #management #replication

Updated: 2026-07-31
Lists: 1 list mention
First commit: 2014-02-04
History: 95 history points
License: Apache-2.0
Issues: Disabled

2,270

stars

Forks: 750
Commits: 6,558 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

microsoft/GraphEngine

Microsoft Graph Engine

Stack

C# CMake .NET SDK

GitHub topics

#distributed-computing #dotnet #graph-engine #graph-query-language #in-memory-computations #in-memory-storage

Updated: 2024-10-08
Lists: 1 list mention
First commit: 2017-02-09
History: 94 history points
License: MIT
Issues: 47 open

2,263

stars

Forks: 335
Commits: 1,795 commits
Star growth, last 7 days: +1 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

twitter/summingbird

Streaming MapReduce with Scalding and Storm

Archived

Stack

Scala

Updated: 2022-01-19
Lists: 2 list mentions
First commit: 2012-09-25
History: 6 history points
License: Apache-2.0
Issues: 162 open

2,123

stars

Forks: 256
Commits: 1,793 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

mara/mara-pipelines

A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow

Stack

Python pytest PEP 517 pip

GitHub topics

#data #data-integration #etl #pipeline #postgresql #python

Updated: 2023-12-15
Lists: 1 list mention
First commit: 2018-04-08
History: 96 history points
License: MIT
Issues: 26 open

2,089

stars

Forks: 101
Commits: 172 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

tinkerpop/gremlin

A Graph Traversal Language (no longer active - see Apache TinkerPop)

Stack

Java Maven

Updated: 2021-08-16
Lists: 1 list mention
First commit: 2009-11-07
History: 6 history points
License: NOASSERTION
Issues: Disabled

1,951

stars

Forks: 229
Commits: 1,227 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

baidu/tera

An Internet-Scale Database.

Stack

C++ CMake Maven

GitHub topics

#baidu #bigtable #c-plus-plus #data #database #hbase

Updated: 2024-06-05
Lists: 1 list mention
First commit: 2014-03-26
History: 6 history points
License: BSD-3-Clause
Issues: 172 open

1,903

stars

Forks: 434
Commits: 2,252 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

biokoda/actordb

ActorDB distributed SQL database

Stack

Erlang

Updated: 2022-11-10
Lists: 1 list mention
First commit: 2014-01-21
History: 6 history points
License: MPL-2.0
Issues: 32 open

1,887

stars

Forks: 71
Commits: 397 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

pinterest/secor

Secor is a service implementing Kafka log persistence

AI dev

Stack

Java Maven

GitHub topics

#kafka

Updated: 2026-03-10
Lists: 1 list mention
First commit: 2014-04-15
History: 6 history points
License: Apache-2.0
Issues: 269 open

1,857

stars

Forks: 537
Commits: 3,338 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

GitHub

Search awesome repositories

Find repositories

Put your repository first

How it works

Pricing

How it works

Pricing