← Back to search
github Archived

Repository profile

FMInference/FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.

Python Apache-2.0 main Stack scanned README.md
Stars
9,362
Forks
590
Watchers
5
Issues
58
Commits
107
Awesome lists
1

Repository updates

Follow repository updates

Get generated FMInference/FlexLLMGen development summaries by email, or follow the weekly and monthly RSS feeds.

Sign in to subscribe by email. RSS feeds are public.

Sign in to subscribe

Activity and growth

Tracked growth, recent movement, and commit velocity from stored repository snapshots.

Latest capture 2026-07-04 03:10

Star growth, last 7 days
No 7-day history
Commit velocity, last 7 days
No 7-day history
Stars since baseline
-5
Snapshot coverage
4

Tracked growth

4 captures since 2026-05-27

Stars from baseline -5

Time horizon

All tracked data

Stars history

Total stars

Commits history

Default branch commits

Detected stack

Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.

Scanned 2026-07-04 03:10

Stack signals
5
Package managers
3
Manifest files
73
Dependencies
782

Frameworks and tools

  • Flask web framework · high confidence
  • Jupyter notebook · high confidence
  • pytest test framework · high confidence
  • Streamlit app framework · high confidence
  • Tornado web framework · high confidence
Bundler PEP 517 pip python ruby

Dependency files

73 manifests
  • pyproject.toml python ecosystem, 7 dependencies
  • benchmark/third_party/DeepSpeed/setup.cfg python ecosystem, 0 dependencies
  • benchmark/third_party/DeepSpeed/setup.py python ecosystem, 0 dependencies
  • benchmark/third_party/transformers/pyproject.toml python ecosystem, 0 dependencies
  • benchmark/third_party/transformers/setup.cfg python ecosystem, 0 dependencies
  • benchmark/third_party/transformers/setup.py python ecosystem, 0 dependencies
  • benchmark/third_party/DeepSpeed/docs/Gemfile ruby ecosystem, 9 dependencies
  • benchmark/third_party/DeepSpeed/requirements/requirements.txt python ecosystem, 9 dependencies
  • 65 more files

Classification

Searchable topics, generated tags, and stack labels that explain where this repository fits.

Topics
7
Tags
0
Stacks
5

AI development signals

Agent instructions and tool configuration paths found in the repository tree.

0 paths
No AI development config files detected.

Similar repositories

Nearest indexed repositories by embedding similarity.

bobazooba/xllm

🦖 X—LLM: Cutting Edge & Easy LLM Finetuning

409 stars
Python 1 awesome list

Tiiny-AI/PowerInfer

High-speed Large Language Model Serving for Local Deployment

9,636 stars
C++ 1 awesome list

hpcaitech/ColossalAI

Making large AI models cheaper, faster and more accessible

41,412 stars
Python 4 awesome lists

OptimalScale/LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

8,484 stars
Python 2 awesome lists

Metadata

Language
Python
License
Apache-2.0
Default branch
main
Created
2023-02-15
First commit
2023-02-15
Last pushed
2024-10-28
GitHub updated
2026-07-03
Last synced
2026-07-04 03:10
Stack detected
2026-07-04 03:10
Archived
yes

Appears in

1