Skip to content
Projects

ofirpress/attention_with_linear_biases

View on GitHub

ofirpress/attention_with_linear_biases has 558 GitHub stars and 42 forks. GitHot measured 0 stars in 24 hours. Last checked 2026-11-15 21:47 UTC. Last push 2023-10-30.

How these counts are measured

Measured star growth

in 24h
0
in 7 days
Collecting history
in 15 days
Collecting history
in 1 month
Collecting history

Net star changes over overlapping periods, not daily totals. Missing measurements are left blank. Stars measure attention, not software quality.

About

Code for the ALiBi method for transformer language models (ICLR 2022)

Developer Tools

README.md

Original