meta-llama/llama
Inference code for Llama models
59434 stars
Python
1 awesome list
kennethleungty/Llama-2-Open-Source-LLM-CPU-Inference
Running Llama 2 and other Open-Source LLMs on CPU Inference Locally for Document Q&A
- Stars
- 974
- Forks
- 207
- Commits
- —
- Language
- Python
- Awesome lists
- 1
Similar repositories
ggml-org/llama.cpp
LLM inference in C/C++
113297 stars
C++
2 awesome lists
danielgross/LlamaAcademy
A school for camelids
1201 stars
Python
1 awesome list
curiousily/Get-Things-Done-with-Prompt-Engineering-and-LangChain
LangChain & Prompt Engineering tutorials on Large Language Models (LLMs) such as ChatGPT with custom data. Jupyter notebooks on loading and indexing data, creating prompt templates, CSV agents, and using retrieval QA chains to query the custom data. Projects for using a private LLM (Llama 2) for chat with PDF files, tweets sentiment analysis.
1241 stars
Jupyter Notebook
2 awesome lists
turboderp-org/exllamav2
A fast inference library for running LLMs locally on modern consumer-class GPUs
4534 stars
Python
1 awesome list
getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
10961 stars
TypeScript
3 awesome lists
Tracked growth
1 capture since 2026-05-27
Latest capture 2026-05-27 12:44
Stars history
Total starsCommits history
Default branch commitsMetadata
- Created: 2023-07-06
- First commit: —
- Last pushed: 2023-11-06
- Website: https://towardsdatascience.com/running-llama-2-on-cpu-inference-for-document-q-a-3d636037a3d8
- Archived: no
- Stack detected: —
- License: MIT
AI development signals
No AI development config files detected.