Awesome List

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

oxnr/awesome-bigdata #awesome #awesome-list #bigdata #data #data-analytics #data-science #data-stream #data-visualization #data-warehouse #database #distributed-database #series-database #stream-processing #streaming-data #visualize-data 404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=4577 | rate_limit_reset=1784288973

Open GitHub

List stars: 14,494
README repos: 211
Indexed repos: 183
List commits: 592
Forks: 2,586
Open issues: 9

Tracked list growth

GitHub stars and default-branch commits for oxnr/awesome-bigdata.

Latest scan 2026-07-17 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

25 repos matching these filters.

Language: Go

Latest repo push 2026-07-17

Browse

Filter this list

Search within Awesome Bigdata or narrow by ecosystem and project health.

Clear 1 refinement

Search repositories

Search mode

Keyword Semantic

Tune results

The controls most people need first.

Language

Freshness

Sort

Direction

More filters Topics, generated tags, stack, files, age, archive status, and growth.

Ecosystem

GitHub topic

Generated tag

Framework or stack

Package manager

Files

Has file

Choose a suggestion or use commas to require multiple files.

Health

Minimum stars

Repository age

Uses known first-commit dates.

Archive status

AI development signals

Momentum

Unmaintained for

Commit velocity

Star growth

Reset filters

Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

AI dev

Stack

Go Axum Cobra Gin gRPC Go Cargo CMake Conan

GitHub topics

#anns #cloud-native #diskann #distributed #embedding-database #embedding-similarity

Updated: 2026-07-17
Lists: 7 list mentions
First commit: 2019-03-18
License: Apache-2.0
Issues: 1,101 open

45,249

stars

Forks: 4,123
Commits: 25,109 commits
Star growth, last 7 days: +71 +0.2%
Commit velocity, last 7 days: +48 +0.2%

Website GitHub

pingcap/tidb

TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.

AI dev

Stack

Go Cobra gRPC Go Go modules pip

GitHub topics

#agent #agent-context #agent-memory #agentic #ai #cloud-native

Updated: 2026-07-07
Lists: 3 list mentions
First commit: 2015-09-06
License: Apache-2.0
Issues: 6,462 open

40,257

stars

Forks: 6,219
Commits: 28,316 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

cockroachdb/cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

AI dev

Stack

Go Cobra Django Gin gRPC Go .NET SDK Go modules Maven

GitHub topics

#cockroachdb #database #distributed-database #go #hacktoberfest #sql

Updated: 2026-07-06
Lists: 2 list mentions
First commit: 2014-02-06
License: NOASSERTION
Issues: 8,154 open

32,288

stars

Forks: 4,067
Commits: 118,957 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

dgraph-io/dgraph

high-performance graph database for real-time use cases

Stack

Go Cobra gRPC Go Go modules npm

GitHub topics

#database #distributed #go #knowledge-graph

Updated: 2026-07-12
Lists: 2 list mentions
First commit: 2015-08-25
License: Apache-2.0
Issues: 84 open

21,741

stars

Forks: 1,596
Commits: 6,516 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

VictoriaMetrics/VictoriaMetrics

VictoriaMetrics: fast, cost-effective monitoring solution and time series database

AI dev

Stack

Go gRPC Go React Vite Go modules npm

GitHub topics

#database #grafana #graphite #influxdb #kubernetes #monitoring

Updated: 2026-07-06
Lists: 6 list mentions
First commit: 2018-09-30
License: Apache-2.0
Issues: 773 open

17,292

stars

Forks: 1,687
Commits: 12,639 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

cayleygraph/cayley

An open-source graph database

Stack

Go Cobra Gin gRPC Go Go modules

GitHub topics

#cayley #go #graph #graph-database #linked-data

Updated: 2026-05-05
Lists: 1 list mention
First commit: 2014-06-20
License: Apache-2.0
Issues: 92 open

15,048

stars

Forks: 1,234
Commits: 1,776 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

boltdb/bolt

An embedded key/value database for Go.

Archived

Stack

GitHub topics

#database #go #key-value

Updated: 2018-03-02
Lists: 1 list mention
First commit: 2013-12-20
License: MIT
Issues: 84 open

14,640

stars

Forks: 1,540
Commits: 816 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

juicedata/juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

AI dev

Stack

Go Cobra gRPC Go Go modules Maven npm

GitHub topics

#bigdata #cloud-native #distributed-systems #filesystem #go #golang

Updated: 2026-07-13
Lists: 3 list mentions
First commit: 2021-01-08
License: Apache-2.0
Issues: 168 open

14,188

stars

Forks: 1,254
Commits: 4,435 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

thanos-io/thanos

Highly available Prometheus setup with long term storage capabilities. A CNCF Incubating project.

Stack

Go gRPC Go React Go modules npm pnpm

GitHub topics

#cncf #go #google-cloud-storage #hacktoberfest #high-availability #metrics

Updated: 2026-07-17
Lists: 2 list mentions
First commit: 2017-11-01
License: Apache-2.0
Issues: 875 open

14,153

stars

Forks: 2,333
Commits: 4,954 commits
Star growth, last 7 days: +8 +0.1%
Commit velocity, last 7 days: +16 +0.3%

Website GitHub

tidwall/tile38

Real-time Geospatial and Geofencing

Stack

Go gRPC Go Go modules

GitHub topics

#database #geo #geofences #geospatial #index #location

Updated: 2026-07-10
Lists: 3 list mentions
First commit: 2016-03-04
License: MIT
Issues: 166 open

9,685

stars

Forks: 618
Commits: 1,509 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

tidwall/buntdb

BuntDB is an embeddable, in-memory key/value database for Go with custom indexing and geospatial support

Stack

Go Go modules

GitHub topics

#database #geospatial #golang #in-memory #key-value

Updated: 2026-05-19
Lists: 3 list mentions
First commit: 2016-07-19
License: MIT
Issues: 32 open

4,860

stars

Forks: 304
Commits: 174 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev

Stack

Go Cobra Gin gRPC Go Go modules pip

GitHub topics

#bigquery #cdp #customer-data #customer-data-lake #customer-data-pipeline #customer-data-platform

Updated: 2026-07-06
Lists: 3 list mentions
First commit: 2019-07-19
License: NOASSERTION
Issues: 36 open

4,452

stars

Forks: 53
Commits: 6,582 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev

Stack

Go Go modules npm PEP 517

GitHub topics

#bigquery #copy-database #data-ingestion #data-integration #data-pipeline #duckdb

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2024-02-12
License: NOASSERTION
Issues: 22 open

3,781

stars

Forks: 143
Commits: 2,987 commits
Star growth, last 7 days: +23 +0.6%
Commit velocity, last 7 days: +46 +1.6%

Website GitHub

mozilla-services/heka

DEPRECATED: Data collection and processing made easy.

Archived

Stack

Go CMake

Updated: 2024-01-23
Lists: 1 list mention
First commit: 2012-10-10
License: NOASSERTION
Issues: 232 open

3,402

stars

Forks: 517
Commits: 4,118 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

FeatureBaseDB/featurebase

A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase

Archived

Stack

Go Cobra Echo Gin gRPC Go Go modules npm Yarn

GitHub topics

#big-data #bitmap #database #go #index #pilosa

Updated: 2024-02-21
Lists: 1 list mention
First commit: 2013-10-16
License: Apache-2.0
Issues: 7 open

2,525

stars

Forks: 238
Commits: 5,576 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

influxdata/kapacitor

Open source framework for processing, monitoring, and alerting on time series data

AI dev

Stack

Go Cobra gRPC Go Go modules pip

GitHub topics

#kapacitor #monitoring #time-series

Updated: 2026-07-10
Lists: 1 list mention
First commit: 2015-08-31
License: MIT
Issues: 836 open

2,371

stars

Forks: 478
Commits: 2,056 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

AI dev

Stack

Go Cargo Go modules npm

GitHub topics

#analytics #bigquery #data-analysis #data-ingestion #data-modeling #data-pipelines

Updated: 2026-07-16
Lists: 1 list mention
First commit: 2023-07-25
License: Apache-2.0
Issues: 33 open

1,642

stars

Forks: 84
Commits: 7,893 commits
Star growth, last 7 days: +3 +0.2%
Commit velocity, last 7 days: +78 +1.0%

Website GitHub

tidwall/summitdb

In-memory NoSQL database with ACID transactions, Raft consensus, and Redis API

Archived

Stack

GitHub topics

#database #geospatial #in-memory #json #nosql #raft

Updated: 2022-04-22
Lists: 1 list mention
First commit: 2016-10-04
License: NOASSERTION
Issues: 12 open

1,410

stars

Forks: 76
Commits: 77 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

krotik/eliasdb

EliasDB a graph-based database.

Stack

Go Vue Go modules npm

GitHub topics

#cluster #clustering #database #embedded #golang #graph

Updated: 2022-08-14
Lists: 2 list mentions
First commit: 2016-08-13
License: MPL-2.0
Issues: 14 open

1,037

stars

Forks: 49
Commits: 91 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

gazette/core

Build platforms that flexibly mix SQL, batch, and stream processing paradigms

AI dev

Stack

Go gRPC Go CMake Go modules pip

GitHub topics

#brokers #event-sourcing #golang #stream-processing #streaming-platforms

Updated: 2026-07-10
Lists: 1 list mention
First commit: 2015-03-09
License: MIT
Issues: 23 open

796

stars

Forks: 58
Commits: 1,062 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

skizzehq/skizze

A probabilistic data structure service and storage

Stack

Updated: 2016-05-10
Lists: 2 list mentions
First commit: 2015-07-31
License: MIT
Issues: 10 open

772

stars

Forks: 61
Commits: 439 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

jakekgrog/GhostDB

GhostDB is a distributed, in-memory, general purpose key-value data store that delivers microsecond performance at any scale.

Stack

Go Go modules

GitHub topics

#cache #database #datastore #distributed-database #golang #in-memory-database

Updated: 2021-03-10
Lists: 1 list mention
First commit: 2020-05-19
License: BSD-3-Clause
Issues: 12 open

753

stars

Forks: 42
Commits: 72 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

deroproject/graviton

Graviton Database: ZFS for key-value stores.

Stack

Go Go modules

Updated: 2022-01-30
Lists: 1 list mention
First commit: 2020-09-04
License: GPL-3.0
Issues: 4 open

424

stars

Forks: 22
Commits: 9 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

GitHub

brexhq/substation

Substation is a toolkit for routing, normalizing, and enriching security event and audit logs.

Stack

Go Cobra gRPC Go Go modules

GitHub topics

#automation #aws #logging #monitoring #observability #security

Updated: 2026-01-20
Lists: 2 list mentions
First commit: 2022-04-19
License: MIT
Issues: 3 open

403

stars

Forks: 35
Commits: 250 commits
Star growth, last 7 days: No 7-day history
Commit velocity, last 7 days: No 7-day history

Website GitHub

chrislusf/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.

Stack

Go Cobra Gin gRPC Go Cargo Go modules Maven

Updated: 2026-07-01
Lists: 2 list mentions
First commit: 2011-11-30
License: Apache-2.0
Issues: Disabled

stars

Forks: 7
Commits: 12,815 commits
Star growth, last 7 days: 0 0.0%
Commit velocity, last 7 days: 0 0.0%

Website GitHub

Activity

Default branch: master
Last pushed: 2026-05-19
GitHub updated: 2026-07-17
Created: 2014-07-04
First commit: -
Last scanned: 2026-07-17 10:49
Watchers: 821

Indexed repo mix

Repo stars: 1,493,476
Repo forks: 351,988
Active: 150
Archived: 33

Languages

Java (44) Go (25) Python (23) C++ (18) JavaScript (15) Scala (15) C (8) Erlang (5) TypeScript (5) Rust (4) Clojure (3) C# (2)

Awesome Bigdata

Tracked list growth

Likes history

Commits history

Indexed repositories

Filter this list

Put your repository first

How it works

Pricing