Proyectos
Ver en GitHub
GeeeekExplorer/transformers-patch
GeeeekExplorer/transformers-patch has 38 GitHub stars and 6 forks. GitHot measured 0 stars in 24 hours and 0 in 7 days. Last checked 2026-11-20 04:03 UTC. Last push 2026-05-09.
What you can do
- Memory Reduction - Significantly lowers memory usage in Transformers models
- Zero Configuration - Works automatically after import
Crecimiento de estrellas medido
- in 24h
- 0
- in 7 days
- 0
- in 15 days
- Recopilando historial
- in 1 month
- Recopilando historial
Cambios netos en períodos que se solapan, no totales diarios. Los datos no disponibles se dejan en blanco. Las estrellas indican interés, no calidad.
Acerca de
patches for huggingface transformers to save memory
Aprendizaje automáticoREADME.md
OriginalTransformers-Patch 🛠️
Memory optimization patches for HuggingFace Transformers.
Features ✨
Memory Reduction - Significantly lowers memory usage in Transformers models
Zero Configuration - Works automatically after import
Installation ⚡
pip install git+https://github.com/GeeeekExplorer/transformers-patch.git
Quick Start 🚀
Just import the patch before loading any Transformers models:
import transformers_patch
from transformers import AutoModel
Benchmark 📊
Test Configuration:
- 8x GPU machine
- Micro batch size: 1
- Sequence length: 4096
- Gradient checkpointing: Disabled
- Model: Qwen3-8B
| Memory Component | Fixed Allocation | Before Patch | After Patch |
|---|---|---|---|
| Model + Gradients | 30.5 GB | - | - |
| ZeRO Optimizer States | 11.4 GB | - | - |
| Activations | - | 35.4 GB | 17.8 GB |
50% reduction in activation memory!
Example Usage 📋
See complete example in train.py.