github Actively maintained

dqbd/tiktokenizer

Online playground for OpenAPI tokenizers

2 awesome lists

Quick read

Stars
1,670
Forks
183
Open issues
21
Commits
59

Activity and growth

Latest capture 2026-08-15 03:04

Stars · last 7 days
No history
Commits · last 7 days
No history
Stars since tracking
+63
Stored snapshots
7

Classification

Metadata

Language
TypeScript
License
MIT
Default branch
master
Created
2023-03-02
First commit
2023-03-02
Last pushed
2025-04-24
GitHub updated
2026-08-12
Last synced
2026-08-15 03:04
Stack scanned
2026-08-15 03:04
Archived
No

AI development signals

0 paths

Agent instructions and tool configuration found in this repository.

No config files detected.

Growth history

Tracked growth

7 observed captures since 2026-05-27. Observed captures are shown by default.

Stars from first capture +63

Chart data

Observed captures only

Time horizon

All tracked data

Custom date range

Stars history

Observed snapshots

Commits history

Observed snapshots

Similar repositories

Nearest indexed repositories by embedding similarity.

huggingface/tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

10,943 stars
Rust 3 awesome lists

botisan-ai/gpt3-tokenizer

Isomorphic JavaScript/TypeScript Tokenizer for GPT-3 and Codex Models by OpenAI.

170 stars
TypeScript 1 awesome list

openai/tiktoken

tiktoken is a fast BPE tokeniser for use with OpenAI's models.

18,970 stars
Python 1 awesome list

hegelai/prompttools

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

3,046 stars
Python 3 awesome lists