github Actively maintained

marcelroed/gigatoken

Language model tokenization at GB/s

1 awesome list

Quick read

Stars
4,080
Forks
216
Open issues
17
Commits
368

Activity and growth

Latest capture 2026-09-07 10:54

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
0
Stored snapshots
1

Classification

Technology stack

Metadata

Language
Rust
License
MIT
Default branch
main
Created
2025-11-10
First commit
2025-10-05
Last pushed
2026-09-02
GitHub updated
2026-09-07
Last synced
2026-09-07 10:54
Stack scanned
2026-09-07 10:54
Archived
No

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

1 observed capture since 2026-09-07. Observed captures are shown by default.

Stars from first capture 0

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

certik/fastGPT

Fast GPT-2 inference written in Fortran

199 stars
Fortran 1 awesome list

huggingface/tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

11,030 stars
Rust 3 awesome lists

karpathy/nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

62,156 stars
Python 2 awesome lists

karpathy/nanochat

The best ChatGPT that $100 can buy.

58,058 stars
Python 2 awesome lists

decolua/9router

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

25,511 stars
JavaScript 2 awesome lists