Awesome List

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

oxnr/awesome-bigdata #awesome #awesome-list #bigdata #data #data-analytics #data-science #data-stream #data-visualization #data-warehouse #database #distributed-database #series-database #stream-processing #streaming-data #visualize-data 404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=3838 | rate_limit_reset=1788436169
List stars
14,609
README repos
214
Indexed repos
186
List commits
592
Forks
2,588
Open issues
5

Tracked list growth

GitHub stars and default-branch commits for oxnr/awesome-bigdata.

Latest scan 2026-09-03 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

186 repos currently saved from this list.

No filters applied
Latest repo push 2026-09-04

Filter this list

Search within Awesome Bigdata or narrow by ecosystem and project health.

Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

square/cubism

Cubism.js: A JavaScript library for time series visualization.

Stack
Updated
2025-04-01
Lists
2 list mentions
First commit
2012-03-28
License
NOASSERTION
Issues
42 open
Forks
513
Commits
112 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
infiniflow/infinity

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

AI dev
Updated
2026-08-01
Lists
4 list mentions
First commit
2022-07-18
License
Apache-2.0
Issues
64 open
Forks
435
Commits
3,159 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
rudderlabs/rudder-server

Privacy and Security focused Segment-alternative, in Golang and React

AI dev
Updated
2026-08-21
Lists
3 list mentions
First commit
2019-07-19
License
NOASSERTION
Issues
53 open
Forks
60
Commits
6,638 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
basho/riak

Riak is a decentralized datastore from Basho Technologies.

Stack
Updated
2026-08-14
Lists
1 list mention
First commit
2009-08-07
License
Apache-2.0
Issues
150 open
Forks
521
Commits
3,227 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
facebookarchive/scribe

Scribe is a server for aggregating log data streamed in real time from a large number of servers.

Archived
Stack
Updated
2020-08-27
Lists
1 list mention
First commit
2008-10-23
License
Apache-2.0
Issues
Disabled
Forks
772
Commits
118 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
bruin-data/ingestr

ingestr is a CLI tool to copy data between any databases with a single command seamlessly.

AI dev
Updated
2026-08-02
Lists
2 list mentions
First commit
2024-02-12
License
NOASSERTION
Issues
10 open
Forks
144
Commits
3,101 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Netflix/atlas

In-memory dimensional time series database.

AI dev
Stack
Updated
2026-09-03
Lists
1 list mention
First commit
2014-08-05
License
Apache-2.0
Issues
8 open
Forks
358
Commits
3,021 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
ml-tooling/ml-workspace

🛠 All-in-one web-based IDE specialized for machine learning and data science.

Updated
2024-07-26
Lists
3 list mentions
First commit
2019-05-27
License
Apache-2.0
Issues
0 open
Forks
458
Commits
847 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
apache/linkis

Apache Linkis builds a computation middleware layer to facilitate connection, governance and orchestration between the upper applications and the underlying data engines.

Updated
2026-09-03
Lists
1 list mention
First commit
2019-07-23
License
Apache-2.0
Issues
182 open
Forks
1,169
Commits
4,342 commits
Star growth, last 7 days
+4 +0.1%
Commit velocity, last 7 days
0 0.0%
WeBankFinTech/DataSphereStudio

DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

Updated
2025-11-04
Lists
1 list mention
First commit
2019-11-24
License
Apache-2.0
Issues
360 open
Forks
1,037
Commits
12,523 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
benedekrozemberczki/pytorch_geometric_temporal

PyTorch Geometric Temporal: Spatiotemporal Signal Processing with Neural Machine Learning Models (CIKM 2021)

Updated
2026-05-30
Lists
3 list mentions
First commit
2020-06-27
License
MIT
Issues
30 open
Forks
405
Commits
2,062 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
baidu/bfs

The Baidu File System.

Stack
C++
Updated
2018-12-03
Lists
1 list mention
First commit
2014-11-13
License
BSD-3-Clause
Issues
119 open
Forks
552
Commits
2,139 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
samizdatco/arbor

a graph visualization library using web workers and jQuery

Stack
Updated
2020-04-10
Lists
2 list mentions
First commit
2011-01-12
License
Unknown
Issues
56 open
Forks
623
Commits
12 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
FeatureBaseDB/featurebase

A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase

Archived
Updated
2024-02-21
Lists
1 list mention
First commit
2013-10-16
License
Apache-2.0
Issues
7 open
Forks
239
Commits
5,576 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
datopian/portaljs

🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless).

AI dev
Updated
2026-08-25
Lists
1 list mention
First commit
2011-03-09
License
MIT
Issues
73 open
Forks
334
Commits
3,497 commits
Star growth, last 7 days
+5 +0.2%
Commit velocity, last 7 days
0 0.0%
benedekrozemberczki/karateclub

Karate Club: An API Oriented Open-source Python Framework for Unsupervised Learning on Graphs (CIKM 2020)

Updated
2024-07-17
Lists
3 list mentions
First commit
2019-12-05
License
GPL-3.0
Issues
12 open
Forks
255
Commits
2,319 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
apache/gobblin

A distributed data integration framework that simplifies common aspects of big data integration such as data ingestion, replication, organization and lifecycle management for both streaming and batch data ecosystems.

Updated
2026-07-31
Lists
1 list mention
First commit
2014-02-04
License
Apache-2.0
Issues
Disabled
Forks
749
Commits
6,558 commits
Star growth, last 7 days
+1 0.0%
Commit velocity, last 7 days
0 0.0%
biokoda/actordb

ActorDB distributed SQL database

Stack
Updated
2022-11-10
Lists
1 list mention
First commit
2014-01-21
License
MPL-2.0
Issues
32 open
Forks
71
Commits
397 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
pinterest/secor

Secor is a service implementing Kafka log persistence

AI dev
Stack
GitHub topics
Updated
2026-03-10
Lists
1 list mention
First commit
2014-04-15
License
Apache-2.0
Issues
269 open
Forks
537
Commits
3,338 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
aklivity/zilla

🦎 A lightweight, multi-protocol gateway for event-driven applications and AI agents. Expose and govern Kafka, MQTT, APIs, and MCP through one high-performance engine with shared routing, security, schema, and observability.

AI dev
Updated
2026-09-04
Lists
1 list mention
First commit
2021-12-07
License
NOASSERTION
Issues
254 open
Forks
147
Commits
3,988 commits
Star growth, last 7 days
0 0.0%
Commit velocity, last 7 days
0 0.0%
bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

AI dev
Updated
2026-08-02
Lists
2 list mentions
First commit
2023-07-25
License
Apache-2.0
Issues
28 open
Forks
86
Commits
8,067 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history