sooftware/attentions has 548 GitHub stars and 73 forks. GitHot measured 0 stars in 24 hours and 0 in 7 days. Last checked 2026-11-22 05:36 UTC. Last push 2022-03-04.
計測したスター増加
- 24時間
- 0
- 7日間
- 0
- 15日間
- 履歴を収集中
- 1か月
- 履歴を収集中
期間ごとの純増数です。期間は重複しており、日別の値ではありません。未計測の値は空欄です。スター数は注目度の指標であり、品質の保証ではありません。
概要
PyTorch implementation of some attentions for Deep Learning Researchers.
機械学習README.md
オリジナル
An Apache 2.0 PyTorch implementation of some attentions for Deep Learning Researchers.
Intro
attentions provides some attentions used in natural language processing using pytorch.
these attentions can used in neural machine translation, speech recognition, image captioning etc...

attention allows to attend to different parts of the source sentence at each step of the output generation.
Instead of encoding the input sequence into a single fixed context vector, we let the model learn how to generate a context vector for each output time step.
Implementation list
| Name | Citation |
|---|---|
| Additive Attention | Bahdanau et al., 2015 |
| Dot-Product Attention | Luong et al., 2015 |
| Location-Aware (Location Sensitive) Attention | Chorowski et al., 2015 |
| Scaled Dot-Product Attention | Vaswani et al., 2017 |
| Multi-Head Attention | Vaswani et al., 2017 |
| Relative Multi-Head Self Attention | ZihangDai et al., 2019 |
Troubleshoots and Contributing
If you have any questions, bug reports, and feature requests, please open an issue on Github.
or Contacts [email protected] please.
I appreciate any kind of feedback or contribution. Feel free to proceed with small issues like bug fixes, documentation improvement. For major contributions and new features, please discuss with the collaborators in corresponding issues.
Code Style
I follow PEP-8 for code style. Especially the style of docstrings is important to generate documentation.
Author
- Soohwan Kim @sooftware
- Contacts: [email protected]
関連プロジェクトを探す
読み込み中…