Releases: pytorch-labs/attention-gym
Releases · pytorch-labs/attention-gym
Add Sliding Tile Attention impl
What's Changed
- Add natten with static tiling & Morton Curve by @joydddd in #87
- Fix Ruff by @drisspg in #90
- Remove persisted credential by @drisspg in #91
- Add
tabulate
used in example to dependencies by @oraluben in #99 - Reduce memory usage by @oraluben in #100
- Fix typos:
casual
->causal
by @awgu in #102 - Add end-to-end example for paged attention by @BoyuanFeng in #104
- Adapt paged attention implementation from pytorch by @BoyuanFeng in #105
- Add option for causal by @drisspg in #107
- fix ci by @drisspg in #114
- Add example for showcasing how to do multi-latent Attention by @drisspg in #113
- Change import structure by @drisspg in #125
- Fix natten x y dims by @fcossio in #128
- add batchify mask-mod by @drisspg in #132
- Make matplotlib lazy by @drisspg in #134
- Proper doc string deepseek ref in latent_attention.py by @curlup in #139
- Add Sliding Tile Attention impl by @yibozhong in #140
- Update workflows by @drisspg in #141
- Fix Publish by @drisspg in #142
New Contributors
- @joydddd made their first contribution in #87
- @oraluben made their first contribution in #99
- @awgu made their first contribution in #102
- @BoyuanFeng made their first contribution in #104
- @fcossio made their first contribution in #128
- @curlup made their first contribution in #139
- @yibozhong made their first contribution in #140
Full Changelog: v0.0.3...v0.0.4
Fix Alibi ordering
What's Changed
- Fix import of transformmodindex on nightly by @drisspg in #52
- Fix minor typo in example by @zinccat in #57
- Fix Format by @drisspg in #61
- Fix typo in readme by @drisspg in #64
- Add Dilated Sliding Window mask_mod by @drisspg in #85
- fix alibi bias by @kashif in #86
New Contributors
Full Changelog: v0.0.2...0.0.3
Fix tanh_softcapping
What's Changed
- Remove gh release by @drisspg in #7
- Fix a typo by @sngkim in #13
- NATTEN example by @Birch-san in #16
- Update softcapping.py by @Chillee in #23
- Use hatch vcs for versioning by @drisspg in #24
New Contributors
- @sngkim made their first contribution in #13
- @Birch-san made their first contribution in #16
- @Chillee made their first contribution in #23
Full Changelog: v0.0.1...v0.0.2