Awesome List

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

oxnr/awesome-bigdata #awesome #awesome-list #bigdata #data #data-analytics #data-science #data-stream #data-visualization #data-warehouse #database #distributed-database #series-database #stream-processing #streaming-data #visualize-data 404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=4577 | rate_limit_reset=1784288973

Open GitHub

List stars: 14,494
README repos: 211
Indexed repos: 183
List commits: 592
Forks: 2,586
Open issues: 9

Tracked list growth

GitHub stars and default-branch commits for oxnr/awesome-bigdata.

Latest scan 2026-07-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

30 repos matching these filters.

Package manager: go-modules

Latest repo push 2026-07-17

Browse

Filter this list

Search within Awesome Bigdata or narrow by ecosystem and project health.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

apache/airflow

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

AI dev

Stack

Python Celery Cobra FastAPI Flask Go modules Gradle npm

GitHub topics

#airflow #apache #apache-airflow #automation #dag #data-engineering

Updated: 2026-07-17
Lists: 5 list mentions
First commit: 2014-10-06
License: Apache-2.0
Issues: 1,739 open

46,152

stars

Forks: 17,393
Commits: 39,742 commits
Star growth, last 7 days: +61 +0.1%
Commit velocity, last 7 days: +101 +0.3%

Website GitHub

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

AI dev

Stack

Go Axum Cobra Gin gRPC Go Cargo CMake Conan

GitHub topics

#anns #cloud-native #diskann #distributed #embedding-database #embedding-similarity

Updated: 2026-07-17
Lists: 7 list mentions
First commit: 2019-03-18
License: Apache-2.0
Issues: 1,101 open

45,249

stars

Forks: 4,123
Commits: 25,109 commits
Star growth, last 7 days: +71 +0.2%
Commit velocity, last 7 days: +48 +0.2%

Website GitHub

pingcap/tidb

TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.

AI dev

Stack

Go Cobra gRPC Go Go modules pip

GitHub topics

#agent #agent-context #agent-memory #agentic #ai #cloud-native

Updated: 2026-07-07
Lists: 3 list mentions
First commit: 2015-09-06
License: Apache-2.0
Issues: 6,462 open

40,257

stars

Forks: 6,219
Commits: 28,316 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

cockroachdb/cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

AI dev

Stack

Go Cobra Django Gin gRPC Go .NET SDK Go modules Maven

GitHub topics

#cockroachdb #database #distributed-database #go #hacktoberfest #sql

Updated: 2026-07-06
Lists: 2 list mentions
First commit: 2014-02-06
License: NOASSERTION
Issues: 8,154 open

32,288

stars

Forks: 4,067
Commits: 118,957 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

taosdata/TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

Stack

C Gin gRPC Go pytest Cargo CMake Conan

GitHub topics

#bigdata #cloud-native #cluster #connected-vehicles #database #distributed

Updated: 2026-07-06
Lists: 2 list mentions
First commit: 2019-07-11
License: AGPL-3.0
Issues: 428 open

24,953

stars

Forks: 5,011
Commits: 85,319 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

dgraph-io/dgraph

high-performance graph database for real-time use cases

Stack

Go Cobra gRPC Go Go modules npm

GitHub topics

#database #distributed #go #knowledge-graph

Updated: 2026-07-12
Lists: 2 list mentions
First commit: 2015-08-25
License: Apache-2.0
Issues: 84 open

21,741

stars

Forks: 1,596
Commits: 6,516 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

VictoriaMetrics/VictoriaMetrics

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

AI dev

Stack

Go gRPC Go React Vite Go modules npm

GitHub topics

#database #grafana #graphite #influxdb #kubernetes #monitoring

Updated: 2026-07-06
Lists: 6 list mentions
First commit: 2018-09-30
License: Apache-2.0
Issues: 773 open

17,292

stars

Forks: 1,687
Commits: 12,639 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

apache/pulsar

Apache Pulsar - distributed pub-sub messaging system

AI dev

Stack

Java gRPC Go Go modules Gradle

GitHub topics

#event-streaming #messaging #pubsub #pulsar #queuing #streaming

Updated: 2026-07-15
Lists: 2 list mentions
First commit: 2016-09-07
License: Apache-2.0
Issues: 1,691 open

15,298

stars

Forks: 3,744
Commits: 14,562 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

cayleygraph/cayley

An open-source graph database

Stack

Go Cobra Gin gRPC Go Go modules

GitHub topics

#cayley #go #graph #graph-database #linked-data

Updated: 2026-05-05
Lists: 1 list mention
First commit: 2014-06-20
License: Apache-2.0
Issues: 92 open

15,048

stars

Forks: 1,234
Commits: 1,776 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

juicedata/juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

AI dev

Stack

Go Cobra gRPC Go Go modules Maven npm

GitHub topics

#bigdata #cloud-native #distributed-systems #filesystem #go #golang

Updated: 2026-07-13
Lists: 3 list mentions
First commit: 2021-01-08
License: Apache-2.0
Issues: 168 open

14,188

stars

Forks: 1,254
Commits: 4,435 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

thanos-io/thanos

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

Stack

Go gRPC Go React Go modules npm pnpm

GitHub topics

#cncf #go #google-cloud-storage #hacktoberfest #high-availability #metrics

Updated: 2026-07-17
Lists: 2 list mentions
First commit: 2017-11-01
License: Apache-2.0
Issues: 875 open

14,153

stars

Forks: 2,333
Commits: 4,954 commits
Star growth, last 7 days: +8 +0.1%
Commit velocity, last 7 days: +16 +0.3%

Website GitHub

yugabyte/yugabyte-db

YugabyteDB - the cloud native distributed SQL database for mission-critical applications.

AI dev

Stack

C Cobra Express FastAPI gRPC Go CMake Go modules Gradle

GitHub topics

#cloud-native #cpp #database #distributed-database #distributed-sql #distributed-sql-database

Updated: 2026-07-17
Lists: 2 list mentions
First commit: 2005-06-28
License: NOASSERTION
Issues: 8,056 open

10,412

stars

Forks: 1,287
Commits: 38,913 commits
Star growth, last 7 days: +11 +0.1%
Commit velocity, last 7 days: +99 +0.3%

Website GitHub

tidwall/tile38

Real-time Geospatial and Geofencing

Stack

Go gRPC Go Go modules

GitHub topics

#database #geo #geofences #geospatial #index #location

Updated: 2026-07-10
Lists: 3 list mentions
First commit: 2016-03-04
License: MIT
Issues: 166 open

9,685

stars

Forks: 618
Commits: 1,509 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

feast-dev/feast

The Open Source Feature Store for AI/ML

AI dev

Stack

Python Astro Cobra FastAPI gRPC Go Go modules Maven npm

GitHub topics

#big-data #data-engineering #data-quality #data-science #feature-store #features

Updated: 2026-07-17
Lists: 2 list mentions
First commit: 2018-12-10
License: Apache-2.0
Issues: 391 open

7,135

stars

Forks: 1,368
Commits: 4,622 commits
Star growth, last 7 days: +8 +0.1%
Commit velocity, last 7 days: +6 +0.1%

Website GitHub

tidwall/buntdb

BuntDB is an embeddable, in-memory key/value database for Go with custom indexing and geospatial support

Stack

Go Go modules

GitHub topics

#database #geospatial #golang #in-memory #key-value

Updated: 2026-05-19
Lists: 3 list mentions
First commit: 2016-07-19
License: MIT
Issues: 32 open

4,860

stars

Forks: 304
Commits: 174 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

infiniflow/infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

AI dev

Stack

C++ CMake Go modules npm

GitHub topics

#ai-native #approximate-nearest-neighbor-search #bm25 #cpp20 #cpp20-modules #embedding

Updated: 2026-07-14
Lists: 3 list mentions
First commit: 2022-07-18
License: Apache-2.0
Issues: 66 open

4,609

stars

Forks: 431
Commits: 3,153 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Cobra Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-07-06
Lists: 3 list mentions
First commit: 2019-07-19
License: NOASSERTION
Issues: 36 open

4,452

stars

Forks: 53
Commits: 6,582 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev

Stack

Go Go modules npm PEP 517

GitHub topics

#bigquery #copy-database #data-ingestion #data-integration #data-pipeline #duckdb

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2024-02-12
License: NOASSERTION
Issues: 22 open

3,781

stars

Forks: 143
Commits: 2,987 commits
Star growth, last 7 days: +23 +0.6%
Commit velocity, last 7 days: +46 +1.6%

Website GitHub

numaproj/numaflow

Kubernetes-native platform to run massively parallel data/streaming jobs

Stack

Rust Axum Cobra Gin gRPC Go Cargo Go modules npm

GitHub topics

#data-processing #hacktoberfest #k8s #kubernetes #map-reduce #pipeline

Updated: 2026-07-11
Lists: 1 list mention
First commit: 2022-05-20
License: Apache-2.0
Issues: 286 open

2,822

stars

Forks: 162
Commits: 1,828 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

FeatureBaseDB/featurebase

A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase

Archived

Stack

Go Cobra Echo Gin gRPC Go Go modules npm Yarn

GitHub topics

#big-data #bitmap #database #go #index #pilosa

Updated: 2024-02-21
Lists: 1 list mention
First commit: 2013-10-16
License: Apache-2.0
Issues: 7 open

2,525

stars

Forks: 238
Commits: 5,576 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

influxdata/kapacitor

Open source framework for processing, monitoring, and alerting on time series data

AI dev

Stack

Go Cobra gRPC Go Go modules pip

GitHub topics

#kapacitor #monitoring #time-series

Updated: 2026-07-10
Lists: 1 list mention
First commit: 2015-08-31
License: MIT
Issues: 836 open

2,371

stars

Forks: 478
Commits: 2,056 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

AI dev

Stack

Go Cargo Go modules npm

GitHub topics

#analytics #bigquery #data-analysis #data-ingestion #data-modeling #data-pipelines

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2023-07-25
License: Apache-2.0
Issues: 33 open

1,642

stars

Forks: 84
Commits: 7,893 commits
Star growth, last 7 days: +3 +0.2%
Commit velocity, last 7 days: +78 +1.0%

Website GitHub

krotik/eliasdb

EliasDB a graph-based database.

Stack

Go Vue Go modules npm

GitHub topics

#cluster #clustering #database #embedded #golang #graph

Updated: 2022-08-14
Lists: 2 list mentions
First commit: 2016-08-13
License: MPL-2.0
Issues: 14 open

1,037

stars

Forks: 49
Commits: 91 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

gazette/core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

AI dev

Stack

Go gRPC Go CMake Go modules pip

GitHub topics

#brokers #event-sourcing #golang #stream-processing #streaming-platforms

Updated: 2026-07-10
Lists: 1 list mention
First commit: 2015-03-09
License: MIT
Issues: 23 open

796

stars

Forks: 58
Commits: 1,062 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

jakekgrog/GhostDB

GhostDB is a distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale.

Stack

Go Go modules

GitHub topics

#cache #database #datastore #distributed-database #golang #in-memory-database

Updated: 2021-03-10
Lists: 1 list mention
First commit: 2020-05-19
License: BSD-3-Clause
Issues: 12 open

753

stars

Forks: 42
Commits: 72 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

deroproject/graviton

Graviton Database: ZFS for key-value stores.

Stack

Go Go modules

Updated: 2022-01-30
Lists: 1 list mention
First commit: 2020-09-04
License: GPL-3.0
Issues: 4 open

424

stars

Forks: 22
Commits: 9 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

brexhq/substation

Substation is a toolkit for routing, normalizing, and enriching security event and audit logs.

Stack

Go Cobra gRPC Go Go modules

GitHub topics

#automation #aws #logging #monitoring #observability #security

Updated: 2026-01-20
Lists: 2 list mentions
First commit: 2022-04-19
License: MIT
Issues: 3 open

403

stars

Forks: 35
Commits: 250 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

NationalSecurityAgency/timely

Accumulo backed time series database

Stack

Java gRPC Go React Spring Boot Go modules Maven npm

GitHub topics

#accumulo #hacktoberfest #series-database #time-series #timeseries

Updated: 2026-05-13
Lists: 1 list mention
First commit: 2016-04-21
License: Apache-2.0
Issues: 20 open

393

stars

Forks: 110
Commits: 489 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

kakao/actionbase

One database for user-user (follows), user-item (likes), and item-item (related items) interactions — precomputed, served in real-time

Stack

Kotlin Astro React Vite Go modules Gradle npm

GitHub topics

#database #graphdb #high-throughput #low-latency #oltp #real-time

Updated: 2026-07-11
Lists: 1 list mention
First commit: 2025-12-09
License: Apache-2.0
Issues: 37 open

222

stars

Forks: 15
Commits: 247 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

chrislusf/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.

Stack

Go Cobra Gin gRPC Go Cargo Go modules Maven

Updated: 2026-07-01
Lists: 2 list mentions
First commit: 2011-11-30
License: Apache-2.0
Issues: Disabled

stars

Forks: 7
Commits: 12,815 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Activity

Default branch: master
Last pushed: 2026-05-19
GitHub updated: 2026-07-17
Created: 2014-07-04
First commit: -
Last scanned: 2026-07-17 10:49
Watchers: 821

Indexed repo mix

Repo stars: 1,493,476
Repo forks: 351,988
Active: 150
Archived: 33

Languages

Java (44) Go (25) Python (23) C++ (18) JavaScript (15) Scala (15) C (8) Erlang (5) TypeScript (5) Rust (4) Clojure (3) C# (2)

Awesome Bigdata

Tracked list growth

Likes history

Commits history

Indexed repositories

Filter this list

Put your repository first

How it works

Pricing