Skip to content

Commit d77d8e8

Browse files
choutimfacebook-github-bot
authored andcommitted
Open source two simplical attention kernels (#4445)
Summary: X-link: facebookresearch/FBGEMM#1508 Kernels for two simplical attention of form: L = Q @ (K1 X K2) P = softmax(L, axis=[-1, -2]) O = P @ (V1 X V2) Reviewed By: jiecaoyu, sijiac Differential Revision: D77756574
1 parent f22a3d4 commit d77d8e8

File tree

2 files changed

+1021
-0
lines changed

2 files changed

+1021
-0
lines changed

0 commit comments

Comments
 (0)