Skip to content
Projects

mlc-ai/tokenizers-cpp

View on GitHub

mlc-ai/tokenizers-cpp has 514 GitHub stars and 131 forks. Star changes are not measured yet. Last checked 2026-11-14 03:31 UTC. Last push 2026-05-20.

How these counts are measured

Measured star growth

in 24h
Collecting history
in 7 days
Collecting history
in 15 days
Collecting history
in 1 month
Collecting history

Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.

About

Universal cross-platform tokenizers binding to HF and sentencepiece

Developer Tools

README.md

Original

Explore related projects