Sign in
← Back to search
github Actively maintained

kyegomez/Sophia

Effortless plugin and play Optimizer to cut model training costs by 50%. New optimizer that is 2x faster than Adam on LLMs.

1 awesome list

Quick read

Stars
382
Forks
26
Open issues
13
Commits
58

Activity and growth

Latest capture 2026-08-15 03:06

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
0
Stored snapshots
6

Classification

Topics

#artificial-intelligence #chatgpt #deep-learning #multi-modality #neural-network #optimizer

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-05-24
First commit
2023-05-24
Last pushed
2024-06-04
GitHub updated
2026-06-30
Last synced
2026-08-15 03:06
Stack scanned
2026-08-15 03:06
Archived
No
Sign in to like kyegomez/Sophia
README Open website View on GitHub

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

6 observed captures since 2026-05-27. Observed captures are shown by default.

Stars from first capture 0

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

NVIDIA/Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

3,371 stars
Python 2 awesome lists

huggingface/optimum

🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools

3,455 stars
Python 1 awesome list

deepspeedai/DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

42,849 stars
Python 1 awesome list

hyperopt/hyperopt

Distributed Asynchronous Hyperparameter Optimization in Python

7,592 stars
Python 1 awesome list

EleutherAI/gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

7,452 stars
Python 3 awesome lists

hpcaitech/ColossalAI

Making large AI models cheaper, faster and more accessible

41,430 stars
Python 4 awesome lists