NousResearch/DisTrO
NousResearch/DisTrO has 1,067 GitHub stars and 60 forks. Star changes are not measured yet. Last checked 2026-11-09 10:49 UTC. Last push 2025-10-14.
Distributed Training Over-The-Internet
Measured star growth
- in 24h
- Update delayed
- in 7 days
- Update delayed
- in 15 days
- Update delayed
- in 1 month
- Update delayed
Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.
README.md
OriginalDisTrO
This is the repository for DisTrO (Distributed Training Over-The-Internet), a family of low latency distributed optimizers that reduce inter-GPU communication requirements by three to four orders of magnitude.
- Aug. 26th, 2024: DisTrO (Preliminary Report)
- Dec. 2nd, 2024: DeMo Optimization (Paper) (Code), original seed research/idea for DisTrO
- Dec. 2nd, 2024: Nous trains a 15b model using DisTrO
- May 14th, 2025: Psyche Network
- May 14th, 2025: Nous Consilience 40b LLM, Huggingface
- Oct. 14th, 2025: DeMo Optimization (Paper v2), (Production Code)
Join us on Discord if you're interested in helping research and build the future of distributed training.
Explore related projects
codecrafters-io/build-your-own-x
Master programming by recreating your favorite technologies from scratch.
561,616 starspublic-apis/public-apis
A collective list of free APIs
497,934 starsmorluto/rea
Reverse engineer anything with agents, from app behavior down to native binaries.
449,932 starsopenclaw/openclaw
The AI that really does things. Any OS. Any Platform. The lobster way. 🦞
394,302 stars