Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
oxnr/awesome-bigdata
#awesome
#awesome-list
#bigdata
#data
#data-analytics
#data-science
#data-stream
#data-visualization
#data-warehouse
#database
#distributed-database
#series-database
#stream-processing
#streaming-data
#visualize-data
404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=3838 | rate_limit_reset=1788436169
- List stars
- 14,609
- README repos
- 214
- Indexed repos
- 186
- List commits
- 592
- Forks
- 2,588
- Open issues
- 5
Tracked list growth
GitHub stars and default-branch commits for oxnr/awesome-bigdata.
Latest scan 2026-09-03 10:49
Likes history
GitHub starsCommits history
Default branch commitsIndexed repositories
186 repos currently saved from this list.
No filters applied
Latest repo push 2026-09-04
radlab/sparrow
Sparrow scheduling platform (U.C. Berkeley).
Archived
- Updated
- 2020-07-25
- Lists
- 1 list mention
- First commit
- 2012-01-21
- License
- Apache-2.0
- Issues
- 4 open
328
stars
- Forks
- 90
- Commits
- 372 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
Hydrospheredata/mist
Serverless proxy for Spark cluster
GitHub topics
- Updated
- 2026-04-13
- Lists
- 2 list mentions
- First commit
- 2016-02-01
- License
- Apache-2.0
- Issues
- 32 open
325
stars
- Forks
- 69
- Commits
- 2,020 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
krestenkrab/hanoidb
Erlang LSM BTree Storage
AI dev
Stack
- Updated
- 2016-08-07
- Lists
- 1 list mention
- First commit
- 2012-01-04
- License
- Apache-2.0
- Issues
- 14 open
313
stars
- Forks
- 55
- Commits
- 377 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
cdapio/tigon
High Throughput Real-time Stream Processing Framework
Archived
- Updated
- 2017-04-05
- Lists
- 1 list mention
- First commit
- 2014-09-05
- License
- Apache-2.0
- Issues
- 1 open
284
stars
- Forks
- 33
- Commits
- 646 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
linkedin/isolation-forest
A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
- Updated
- 2026-08-04
- Lists
- 2 list mentions
- First commit
- 2019-08-12
- License
- NOASSERTION
- Issues
- 1 open
- Forks
- 54
- Commits
- 103 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
damballa/parkour
Hadoop MapReduce in idiomatic Clojure.
Stack
- Updated
- 2016-03-23
- Lists
- 1 list mention
- First commit
- 2013-08-16
- License
- Apache-2.0
- Issues
- 2 open
255
stars
- Forks
- 19
- Commits
- 496 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
infinidb/infinidb
InfiniDB Data Warehouse
- Updated
- 2017-10-14
- Lists
- 1 list mention
- First commit
- 2013-10-15
- License
- GPL-2.0
- Issues
- 1 open
248
stars
- Forks
- 86
- Commits
- 57 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
benedekrozemberczki/shapley
The official implementation of "The Shapley Value of Classifiers in Ensemble Games" (CIKM 2021).
- Updated
- 2026-01-01
- Lists
- 3 list mentions
- First commit
- 2020-01-30
- License
- MIT
- Issues
- 1 open
- Forks
- 35
- Commits
- 358 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
kakao/actionbase
One database for user-user (follows), user-item (likes), and item-item (related items) interactions — precomputed at write time, served as simple lookups
GitHub topics
- Updated
- 2026-09-01
- Lists
- 1 list mention
- First commit
- 2025-12-09
- License
- Apache-2.0
- Issues
- 0 open
225
stars
- Forks
- 17
- Commits
- 316 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
LinkedInAttic/white-elephant
Hadoop log aggregator and dashboard
Archived
- Updated
- 2013-10-29
- Lists
- 1 list mention
- First commit
- 2013-01-24
- License
- NOASSERTION
- Issues
- 14 open
- Forks
- 60
- Commits
- 73 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
Treode/store
The DB that's replicated, sharded and transactional.
- Updated
- 2015-10-31
- Lists
- 1 list mention
- First commit
- 2013-09-25
- License
- Apache-2.0
- Issues
- 0 open
177
stars
- Forks
- 21
- Commits
- 910 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
VCNC/haeinsa
Haeinsa is linearly scalable multi-row, multi-table transaction library for HBase
- Updated
- 2017-02-28
- Lists
- 1 list mention
- First commit
- 2013-01-19
- License
- Apache-2.0
- Issues
- 19 open
160
stars
- Forks
- 40
- Commits
- 468 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
cdapio/tephra
Apache Tephra: Transactions for HBase.
Archived
- Updated
- 2024-09-13
- Lists
- 1 list mention
- First commit
- 2014-07-18
- License
- Apache-2.0
- Issues
- Disabled
159
stars
- Forks
- 42
- Commits
- 263 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
paulhoule/infovore
RDF-Centric Map/Reduce Framework and Freebase data conversion tool
- Updated
- 2021-11-15
- Lists
- 1 list mention
- First commit
- 2012-11-02
- License
- NOASSERTION
- Issues
- 50 open
148
stars
- Forks
- 21
- Commits
- 624 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
Bobris/BTDB
Key Value Database in .Net with Object DB Layer, RPC, dynamic IL and much more
AI dev
- Updated
- 2026-08-25
- Lists
- 1 list mention
- First commit
- 2010-03-06
- License
- MIT
- Issues
- 3 open
144
stars
- Forks
- 41
- Commits
- 2,657 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
SWIMProjectUCB/SWIM
Statistical Workload Injector for MapReduce - Project at UC Berkeley AMP Lab
Stack
- Updated
- 2014-05-29
- Lists
- 1 list mention
- First commit
- 2011-06-02
- License
- Unknown
- Issues
- 3 open
128
stars
- Forks
- 93
- Commits
- 26 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
greenplum-db/PivotalR-archive
An convenient R tool for manipulating tables in PostgreSQL type databases and a wrapper of Apache MADlib.
Archived
Stack
- Updated
- 2022-11-02
- Lists
- 1 list mention
- First commit
- 2013-05-01
- License
- Unknown
- Issues
- 15 open
- Forks
- 52
- Commits
- 387 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
amplab/velox-modelserver
No description.
- Updated
- 2017-04-17
- Lists
- 1 list mention
- First commit
- 2014-07-14
- License
- Apache-2.0
- Issues
- 23 open
110
stars
- Forks
- 26
- Commits
- 154 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
shouc/daudit
🌲 Configuration flaws detector for Hadoop, MongoDB, MySQL, and more!
Archived
- Updated
- 2020-06-21
- Lists
- 1 list mention
- First commit
- 2020-06-08
- License
- MIT
- Issues
- 0 open
105
stars
- Forks
- 21
- Commits
- 43 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ottogroup/schedoscope
Schedoscope is a scheduling framework for painfree agile development, testing, (re)loading, and monitoring of your datahub, lake, or whatever you choose to call your Hadoop data warehouse these days.
Archived
Stack
- Updated
- 2019-11-14
- Lists
- 1 list mention
- First commit
- 2015-05-26
- License
- Apache-2.0
- Issues
- 6 open
- Forks
- 28
- Commits
- 2,276 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
gionkunz/chartist-js
Legacy Chartist Repo for old gh-pages
Stack
- Updated
- 2024-05-06
- Lists
- 2 list mentions
- First commit
- 2014-02-25
- License
- MIT
- Issues
- 11 open
96
stars
- Forks
- 21
- Commits
- 860 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
sonalgoyal/hiho
Hadoop Data Integration with various databases, ftp servers, salesforce. Incremental update, dedup, append, merge your data on Hadoop.
- Updated
- 2013-04-11
- Lists
- 1 list mention
- First commit
- 2010-11-15
- License
- Apache-2.0
- Issues
- 5 open
92
stars
- Forks
- 31
- Commits
- 20 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
apache/incubator-retired-slider
Mirror of Apache Slider
Archived
- Updated
- 2018-12-11
- Lists
- 1 list mention
- First commit
- 2014-05-01
- License
- Apache-2.0
- Issues
- Disabled
- Forks
- 71
- Commits
- 1,974 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
UnderstandLingBV/Tuktu
Big Data Science Swiss Army Knife - http://www.tuktu.io --
Stack
- Updated
- 2018-02-15
- Lists
- 1 list mention
- First commit
- 2014-11-10
- License
- NOASSERTION
- Issues
- 6 open
- Forks
- 16
- Commits
- 1,529 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
unum-cloud/ucsb
Wide NoSQL benchmark for RocksDB, LevelDB, Redis, WiredTiger and MongoDB extending the Yahoo Cloud Serving Benchmark
GitHub topics
- Updated
- 2023-09-08
- Lists
- 1 list mention
- First commit
- 2021-12-08
- License
- Unknown
- Issues
- 3 open
59
stars
- Forks
- 6
- Commits
- 968 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
datasalt/pangool
Tuple MapReduce for Hadoop: Hadoop API made easy
- Updated
- 2022-06-27
- Lists
- 1 list mention
- First commit
- 2011-10-27
- License
- Apache-2.0
- Issues
- 23 open
57
stars
- Forks
- 11
- Commits
- 763 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
chrislusf/seaweedfs
SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.
- Updated
- 2026-07-21
- Lists
- 2 list mentions
- First commit
- 2011-11-30
- License
- Apache-2.0
- Issues
- Disabled
34
stars
- Forks
- 7
- Commits
- 12,815 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
FileShot/FileShotZKE
Client-side AES-256-GCM zero-knowledge encryption library. Browser-native Web Crypto API, no dependencies. Powers FileShot.io.
Stack
- Updated
- 2026-06-03
- Lists
- 2 list mentions
- First commit
- 2026-05-09
- License
- MIT
- Issues
- 1 open
30
stars
- Forks
- 4
- Commits
- 1 commit
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
IBMStreams/streamsx.topology
Develop streaming applications for IBM Streams in Python, Java & Scala.
GitHub topics
- Updated
- 2022-07-24
- Lists
- 1 list mention
- First commit
- 2015-05-28
- License
- Apache-2.0
- Issues
- 3 open
- Forks
- 43
- Commits
- 6,370 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
linkedin-sna/sna-page
SNA team homepage
Stack
- Updated
- 2012-09-05
- Lists
- 1 list mention
- First commit
- 2010-05-25
- License
- Unknown
- Issues
- 0 open
- Forks
- 4
- Commits
- 185 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
renecannao/proxysql
No description.
- Updated
- 2025-11-23
- Lists
- 1 list mention
- First commit
- 2014-12-01
- License
- GPL-3.0
- Issues
- Disabled
26
stars
- Forks
- 7
- Commits
- 7,753 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
LinkedInAttic/kamikaze
DocId set compression and set operation library
- Updated
- 2014-03-07
- Lists
- 1 list mention
- First commit
- 2010-02-27
- License
- Apache-2.0
- Issues
- 4 open
- Forks
- 8
- Commits
- 96 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
ufukomer/bloomery
Web UI for Impala
Stack
- Updated
- 2017-03-17
- Lists
- 1 list mention
- First commit
- 2016-04-14
- License
- Apache-2.0
- Issues
- 0 open
18
stars
- Forks
- 6
- Commits
- 110 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
marty90/netlytics
NetLytics is a Hadoop-powered framework for performing advanced analytics on various kinds of networks logs
Stack
- Updated
- 2018-02-01
- Lists
- 1 list mention
- First commit
- 2017-11-24
- License
- GPL-3.0
- Issues
- 0 open
- Forks
- 2
- Commits
- 56 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
estuary/estuary-warehouse-benchmark
No description.
- Updated
- 2025-07-23
- Lists
- 1 list mention
- First commit
- 2025-06-16
- License
- NOASSERTION
- Issues
- 1 open
- Forks
- 1
- Commits
- 11 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
johnsonc/lambdo
A column-oriented approach to feature engineering. Feature engineering and machine learning: together at last!
- Updated
- 2018-09-10
- Lists
- 1 list mention
- First commit
- 2018-07-15
- License
- MIT
- Issues
- Disabled
1
stars
- Forks
- 18
- Commits
- 44 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%