huggingface/tokenizers

huggingface/tokenizers has 11,219 GitHub stars and 1,243 forks. GitHot measured +2 stars in 24 hours. Last checked 2026-11-04 12:38 UTC. Last push 2026-11-02.

How these counts are measured

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

11,219 stars 1,243 forks +2 in 24h

Measured star growth

in 24h: +2
in 7 days: Update delayed
in 15 days: Update delayed
in 1 month: Update delayed

Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.

README.md

Original

Read the README on GitHub

Explore related projects

codecrafters-io/build-your-own-x

Master programming by recreating your favorite technologies from scratch.

559,855 stars

public-apis/public-apis

A collective list of free APIs

496,136 stars

morluto/rea

Reverse engineer anything with agents, from app behavior down to native binaries.

431,034 stars

openclaw/openclaw

The AI that really does things. Any OS. Any Platform. The lobster way. 🦞

393,919 stars