Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
A curated list of awesome big data frameworks, ressources and other awesomeness.
GitHub stars and default-branch commits for oxnr/awesome-bigdata.
Open highlighted repo slot
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
TiDB is built for agentic workloads that grow unpredictably, with ACID guarantees and native support for transactions, analytics, and vector search. No data silos. No noisy neighbors. No infrastructure ceiling.
CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
high-performance graph database for real-time use cases
An open-source graph database
JuiceFS is a distributed POSIX file system built on top of Redis and S3.
YugabyteDB - the cloud native distributed SQL database for mission-critical applications.
The Open Source Feature Store for AI/ML
Privacy and Security focused Segment-alternative, in Golang and React
Kubernetes-native platform to run massively parallel data/streaming jobs
A crazy fast analytical database, built on bitmaps. Perfect for ML applications. Learn more at: http://docs.featurebase.com/. Start a Docker instance: https://hub.docker.com/r/featurebasedb/featurebase
Open source framework for processing, monitoring, and alerting on time series data
Substation is a toolkit for routing, normalizing, and enriching security event and audit logs.
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.