Sign in
← All awesome lists Search these repos

Awesome List

Awesome Bigdata

A curated list of awesome big data frameworks, ressources and other awesomeness.

oxnr/awesome-bigdata #awesome #awesome-list #bigdata #data #data-analytics #data-science #data-stream #data-visualization #data-warehouse #database #distributed-database #series-database #stream-processing #streaming-data #visualize-data 404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=3838 | rate_limit_reset=1788436169
Open GitHub
List stars
14,609
README repos
214
Indexed repos
186
List commits
592
Forks
2,588
Open issues
5

Tracked list growth

GitHub stars and default-branch commits for oxnr/awesome-bigdata.

Latest scan 2026-09-03 10:49

Likes history

GitHub stars

Commits history

Default branch commits

Indexed repositories

9 repos matching these filters.

Package manager: cargo
Latest repo push 2026-09-04

Filter this list

Search within Awesome Bigdata or narrow by ecosystem and project health.

Clear 1 refinement
Search mode
Tune results
More filters Topics, generated tags, stack, files, age, archive status, and growth.
Ecosystem
Files

Choose a suggestion or use commas to require multiple files.

Health

Uses known first-commit dates.

Momentum
Filters by observed commit-count growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Filters by observed GitHub star growth over the repository's latest 7-day capture window. Repositories without a recent baseline are excluded.
Reset filters
Highlighted

Open highlighted repo slot

Put your repository first

Promote a GitHub repo at the top of Awesome repository list views for 7 days.

milvus-io/milvus

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

AI dev
Stack
Go Axum Cobra Gin gRPC Go Cargo CMake Conan
GitHub topics
#anns #cloud-native #diskann #distributed #embedding-database #embedding-similarity
Updated
2026-09-04
Lists
8 list mentions
First commit
2019-03-18
License
Apache-2.0
Issues
1,320 open
Sign in to like milvus-io/milvus
45,963
stars
Forks
4,223
Commits
25,502 commits
Star growth, last 7 days
+106 +0.2%
Commit velocity, last 7 days
+49 +0.2%
Website GitHub
taosdata/TDengine

High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios

AI dev
Stack
C Gin gRPC Go pytest Cargo CMake Conan
GitHub topics
#bigdata #cloud-native #cluster #connected-vehicles #database #distributed
Updated
2026-08-21
Lists
2 list mentions
First commit
2019-07-11
License
AGPL-3.0
Issues
448 open
Sign in to like taosdata/TDengine
25,079
stars
Forks
5,018
Commits
86,668 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
MaterializeInc/materialize

The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL

AI dev
Stack
Rust Axum FastAPI pytest React Cargo npm PEP 517
GitHub topics
#cdc #data-mesh #data-store #database #distributed-systems #kafka
Updated
2026-09-03
Lists
2 list mentions
First commit
2017-12-05
License
NOASSERTION
Issues
Disabled
Sign in to like MaterializeInc/materialize
6,365
stars
Forks
512
Commits
50,906 commits
Star growth, last 7 days
+2 0.0%
Commit velocity, last 7 days
+50 +0.1%
Website GitHub
bruin-data/bruin

Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.

AI dev
Stack
Go Cargo Go modules npm
GitHub topics
#analytics #bigquery #data-analysis #data-ingestion #data-modeling #data-pipelines
Updated
2026-08-02
Lists
2 list mentions
First commit
2023-07-25
License
Apache-2.0
Issues
28 open
Sign in to like bruin-data/bruin
1,657
stars
Forks
86
Commits
8,067 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
slothflowlabs/duckle

Open-source ETL/ELT on DuckDB. Write, wire, or draw one pipeline: 350+ components, 160+ connectors, dbt, CDC, data quality, a Python API, and MCP for AI agents. Runs anywhere, no lock-in.

Stack
Rust Axum React Tauri Vite Cargo npm PEP 517
GitHub topics
#ai-agents #cdc #connectors #data-engineering #data-integration #data-pipeline
Updated
2026-08-01
Lists
2 list mentions
First commit
2026-05-21
License
Apache-2.0
Issues
56 open
Sign in to like slothflowlabs/duckle
904
stars
Forks
72
Commits
891 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub
chrislusf/seaweedfs

SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.

Stack
Go Cobra Gin gRPC Go Cargo Go modules Maven
Updated
2026-07-21
Lists
2 list mentions
First commit
2011-11-30
License
Apache-2.0
Issues
Disabled
Sign in to like chrislusf/seaweedfs
34
stars
Forks
7
Commits
12,815 commits
Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Website GitHub