Skip to content

Commit 6ac3f33

Browse files
choutimfacebook-github-bot
authored andcommitted
Open source two simplical attention kernels
Summary: Kernels for two simplical attention of form: L = Q @ (K1 X K2) P = softmax(L, axis=[-1, -2]) O = P @ (V1 X V2) Differential Revision: D77756574
1 parent c409ff6 commit 6ac3f33

File tree

2 files changed

+1027
-0
lines changed

2 files changed

+1027
-0
lines changed

0 commit comments

Comments
 (0)