BloomBee
ai-decentralized
Decentralized LLMs fine-tuning and inference with offloading
- Tensor offloading — reduces per-node memory consumption so each peer can host more layers, shrinking the total number of network hops.
- Speculative decoding over internet — reduces communication frequency by sending multiple draft tokens per round-trip.





