Repository profile
Fast inference engine for Transformer models
Repository updates
Get generated OpenNMT/CTranslate2 development summaries by email, or follow the weekly and monthly RSS feeds.
Sign in to subscribe by email. RSS feeds are public.
Sign in to subscribeTracked growth, recent movement, and commit velocity from stored repository snapshots.
Latest capture 2026-07-15 03:16
5 captures since 2026-05-25
Stars from baseline +77
All tracked data
Frameworks, package managers, ecosystems, and dependency manifests found during catalog scans.
Scanned 2026-07-15 03:16
CMakeLists.txt
c-cpp ecosystem,
0 dependencies
cli/CMakeLists.txt
c-cpp ecosystem,
0 dependencies
docs/requirements.txt
python ecosystem,
0 dependencies
python/pyproject.toml
python ecosystem,
0 dependencies
python/setup.cfg
python ecosystem,
0 dependencies
python/setup.py
python ecosystem,
0 dependencies
tests/CMakeLists.txt
c-cpp ecosystem,
0 dependencies
examples/llama2/requirements.txt
python ecosystem,
0 dependencies
Searchable topics, generated tags, and stack labels that explain where this repository fits.
Agent instructions and tool configuration paths found in the repository tree.
Nearest indexed repositories by embedding similarity.
A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations
Ongoing research training transformer models at scale
A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.
Faster Whisper transcription with CTranslate2
Fast GPT-2 inference written in Fortran
State-of-the-Art Embeddings, Retrieval, and Reranking
https://opennmt.net/CTranslate2
README403 Forbidden | https://api.github.com/repos/OpenNMT/CTranslate2/readme | message=API rate limit exceeded for user ID 260990068. If you reach out to GitHub Support for help, please include the request ID BC66:2DA58:D08C2DF:C587571:6A56FB91 and timestamp 2026-07-15 03:16:33 UTC. For more on scraping GitHub and how it may affect your rights, please review our Terms of Service (http | rate_limit_remaining=0 | rate_limit_reset=1784088007
