CoLT5-attention
lucidrains
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
发现模型训练、评估与推理框架,比较深度学习和机器学习项目的社区关注度。
lucidrains
Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch
lucidrains
lucidrains
lucidrains
Implementation of Deformable Attention in Pytorch from the paper "Vision Transformer with Deformable Attention"
lucidrains
lucidrains
lucidrains
lucidrains
A simple and working implementation of Electra, the fastest way to pretrain language models from scratch, in Pytorch
lucidrains
Implementation of E(n)-Transformer, which incorporates attention mechanisms into Welling's E(n)-Equivariant Graph Neural Network
lucidrains
Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch
lucidrains
lucidrains
lucidrains
Implementation of gMLP, an all-MLP replacement for Transformers, in Pytorch
lucidrains
lucidrains
lucidrains
lucidrains
Use Jax functions in Pytorch
lucidrains
lucidrains
lucidrains
Implementation of Linformer for Pytorch
lucidrains
lucidrains
lucidrains
lucidrains