项目
在 GitHub 查看
alphadl/lookahead.pytorch
alphadl/lookahead.pytorch has 336 GitHub stars and 61 forks. GitHot measured 0 stars in 24 hours. Last checked 2026-11-21 19:58 UTC. Last push 2019-08-09.
实测星标增长
- 24小时
- 0
- 7天
- 正在收集历史
- 15天
- 正在收集历史
- 1个月
- 正在收集历史
各周期内的星标净变化,周期相互重叠,并非每日新增。缺失的测量保持空白。星标代表关注度,不代表软件质量。
关于
lookahead optimizer (Lookahead Optimizer: k steps forward, 1 step back) for pytorch
机器学习README.md
原文lookahead optimizer for pytorch
PyTorch implement of Lookahead Optimizer: k steps forward, 1 step back
Usage:
base_opt = torch.optim.Adam(model.parameters(), lr=1e-3, betas=(0.9, 0.999)) # Any optimizer
lookahead = Lookahead(base_opt, k=5, alpha=0.5) # Initialize Lookahead
lookahead.zero_grad()
loss_function(model(input), target).backward() # Self-defined loss function
lookahead.step()
lookahead优化器的PyTorch实现
论文《Lookahead Optimizer: k steps forward, 1 step back》的PyTorch实现。
用法:
base_opt = torch.optim.Adam(model.parameters(), lr=1e-3, betas=(0.9, 0.999)) # 用你想用的优化器
lookahead = Lookahead(base_opt, k=5, alpha=0.5) # 初始化Lookahead
lookahead.zero_grad()
loss_function(model(input), target).backward() # 自定义的损失函数
lookahead.step()
中文介绍:https://mp.weixin.qq.com/s/3J-28xd0pyToSy8zzKs1RA

探索相关项目
加载中…