Highlighted
Open highlighted repo slot
Put your repository first
Promote a GitHub repo at the top of Awesome repository list views for 7 days.
Awesome List
Awesome Bigdata
A curated list of awesome big data frameworks, ressources and other awesomeness.
oxnr/awesome-bigdata
#awesome
#awesome-list
#bigdata
#data
#data-analytics
#data-science
#data-stream
#data-visualization
#data-warehouse
#database
#distributed-database
#series-database
#stream-processing
#streaming-data
#visualize-data
404 Not Found | https://api.github.com/repos/streamsets/datacollector | message=Not Found | rate_limit_remaining=4577 | rate_limit_reset=1784288973
- List stars
- 14,494
- README repos
- 211
- Indexed repos
- 183
- List commits
- 592
- Forks
- 2,586
- Open issues
- 9
Tracked list growth
GitHub stars and default-branch commits for oxnr/awesome-bigdata.
Latest scan 2026-07-17 10:49
Likes history
GitHub starsCommits history
Default branch commits
Latest repo push 2026-07-17
apache/superset
Apache Superset is a Data Visualization and Data Exploration Platform
AI dev
GitHub topics
- Updated
- 2026-07-17
- Lists
- 5 list mentions
- First commit
- 2015-07-02
- License
- Apache-2.0
- Issues
- 658 open
73,865
stars
- Forks
- 17,897
- Commits
- 21,437 commits
- Star growth, last 7 days
- +88 +0.1%
- Commit velocity, last 7 days
- +160 +0.8%
scikit-learn/scikit-learn
scikit-learn: machine learning in Python
AI dev
GitHub topics
- Updated
- 2026-07-15
- Lists
- 3 list mentions
- First commit
- 2010-01-05
- License
- BSD-3-Clause
- Issues
- 2,111 open
66,688
stars
- Forks
- 27,177
- Commits
- 33,829 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
keras-team/keras
Deep Learning for humans
AI dev
GitHub topics
- Updated
- 2026-07-16
- Lists
- 4 list mentions
- First commit
- 2015-03-28
- License
- Apache-2.0
- Issues
- 212 open
64,169
stars
- Forks
- 19,739
- Commits
- 12,542 commits
- Star growth, last 7 days
- -18 0.0%
- Commit velocity, last 7 days
- +23 +0.2%
metabase/metabase
The easy-to-use open source Business Intelligence and Embedded Analytics tool that lets everyone work with data :bar_chart:
AI dev
GitHub topics
- Updated
- 2026-07-17
- Lists
- 5 list mentions
- First commit
- 2015-02-02
- License
- NOASSERTION
- Issues
- 4,100 open
48,233
stars
- Forks
- 6,675
- Commits
- 43,453 commits
- Star growth, last 7 days
- +90 +0.2%
- Commit velocity, last 7 days
- +137 +0.3%
apache/airflow
Apache Airflow - A platform to programmatically author, schedule, and monitor workflows
AI dev
GitHub topics
- Updated
- 2026-07-17
- Lists
- 5 list mentions
- First commit
- 2014-10-06
- License
- Apache-2.0
- Issues
- 1,739 open
46,152
stars
- Forks
- 17,393
- Commits
- 39,742 commits
- Star growth, last 7 days
- +61 +0.1%
- Commit velocity, last 7 days
- +101 +0.3%
ray-project/ray
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
AI dev
- Updated
- 2026-07-16
- Lists
- 4 list mentions
- First commit
- 2016-02-07
- License
- Apache-2.0
- Issues
- 3,449 open
43,253
stars
- Forks
- 7,796
- Commits
- 31,066 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
facebookresearch/faiss
A library for efficient similarity search and clustering of dense vectors.
- Updated
- 2026-07-14
- Lists
- 2 list mentions
- First commit
- 2017-02-22
- License
- MIT
- Issues
- 288 open
40,512
stars
- Forks
- 4,456
- Commits
- 2,176 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
taosdata/TDengine
High-performance, scalable time-series database designed for Industrial IoT (IIoT) scenarios
GitHub topics
- Updated
- 2026-07-06
- Lists
- 2 list mentions
- First commit
- 2019-07-11
- License
- AGPL-3.0
- Issues
- 428 open
24,953
stars
- Forks
- 5,011
- Commits
- 85,319 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
spotify/luigi
Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.
GitHub topics
- Updated
- 2026-07-01
- Lists
- 3 list mentions
- First commit
- 2011-11-17
- License
- Apache-2.0
- Issues
- 163 open
18,745
stars
- Forks
- 2,457
- Commits
- 4,318 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
dagster-io/dagster
An orchestration platform for the development, production, and observation of data assets.
AI dev
- Updated
- 2026-07-06
- Lists
- 4 list mentions
- First commit
- 2018-04-30
- License
- Apache-2.0
- Issues
- 2,568 open
15,795
stars
- Forks
- 2,184
- Commits
- 27,770 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
VowpalWabbit/vowpal_wabbit
Vowpal Wabbit is a machine learning system which pushes the frontier of machine learning with techniques such as online, hashing, allreduce, reductions, learning2search, active, and interactive learning.
- Updated
- 2026-07-15
- Lists
- 2 list mentions
- First commit
- 2009-04-29
- License
- NOASSERTION
- Issues
- 2 open
8,689
stars
- Forks
- 1,925
- Commits
- 10,555 commits
- Star growth, last 7 days
- +1 0.0%
- Commit velocity, last 7 days
- +3 0.0%
feast-dev/feast
The Open Source Feature Store for AI/ML
AI dev
GitHub topics
- Updated
- 2026-07-17
- Lists
- 2 list mentions
- First commit
- 2018-12-10
- License
- Apache-2.0
- Issues
- 391 open
7,135
stars
- Forks
- 1,368
- Commits
- 4,622 commits
- Star growth, last 7 days
- +8 +0.1%
- Commit velocity, last 7 days
- +6 +0.1%
MaterializeInc/materialize
The live data layer for apps and AI agents. Create up-to-the-second views into your business, just using SQL
AI dev
GitHub topics
- Updated
- 2026-07-17
- Lists
- 2 list mentions
- First commit
- 2017-12-05
- License
- NOASSERTION
- Issues
- Disabled
6,334
stars
- Forks
- 512
- Commits
- 50,232 commits
- Star growth, last 7 days
- +6 +0.1%
- Commit velocity, last 7 days
- +90 +0.2%
aimhubio/aim
Aim 💫 — An easy-to-use & supercharged open-source experiment tracker.
- Updated
- 2026-07-09
- Lists
- 4 list mentions
- First commit
- 2019-05-31
- License
- Apache-2.0
- Issues
- 466 open
6,182
stars
- Forks
- 400
- Commits
- 2,265 commits
- Star growth, last 7 days
- No 7-day history
- Commit velocity, last 7 days
- No 7-day history
infiniflow/infinity
The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.
AI dev
Stack
- Updated
- 2026-07-14
- Lists
- 3 list mentions
- First commit
- 2022-07-18
- License
- Apache-2.0
- Issues
- 66 open
4,609
stars
- Forks
- 431
- Commits
- 3,153 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%
bruin-data/ingestr
ingestr is a CLI tool to copy data between any databases with a single command seamlessly.
AI dev
Stack
GitHub topics
- Updated
- 2026-07-16
- Lists
- 1 list mention
- First commit
- 2024-02-12
- License
- NOASSERTION
- Issues
- 22 open
3,781
stars
- Forks
- 143
- Commits
- 2,987 commits
- Star growth, last 7 days
- +23 +0.6%
- Commit velocity, last 7 days
- +46 +1.6%
mara/mara-pipelines
A lightweight opinionated ETL framework, halfway between plain scripts and Apache Airflow
GitHub topics
- Updated
- 2023-12-15
- Lists
- 1 list mention
- First commit
- 2018-04-08
- License
- MIT
- Issues
- 26 open
2,089
stars
- Forks
- 100
- Commits
- 172 commits
- Star growth, last 7 days
- +1 0.0%
- Commit velocity, last 7 days
- 0 0.0%
bruin-data/bruin
Build data pipelines with SQL and Python, ingest data from different sources, add quality checks, and build end-to-end flows.
AI dev
Stack
- Updated
- 2026-07-16
- Lists
- 1 list mention
- First commit
- 2023-07-25
- License
- Apache-2.0
- Issues
- 33 open
1,642
stars
- Forks
- 84
- Commits
- 7,893 commits
- Star growth, last 7 days
- +3 +0.2%
- Commit velocity, last 7 days
- +78 +1.0%
linkedin/isolation-forest
A distributed Spark/Scala implementation of the isolation forest and extended isolation forest algorithms for unsupervised outlier detection, featuring support for scalable training and ONNX export for easy cross-platform inference.
- Updated
- 2026-06-12
- Lists
- 2 list mentions
- First commit
- 2019-08-12
- License
- NOASSERTION
- Issues
- 1 open
- Forks
- 53
- Commits
- 101 commits
- Star growth, last 7 days
- 0 0.0%
- Commit velocity, last 7 days
- 0 0.0%