Skip to content

Fix: use cu_chunk instead of cu_seqlens for flash_attn during corner case where top-k equals 1#26

Open
yibozhong wants to merge 1 commit intoMoonshotAI:masterfrom
yibozhong:master
Open

Fix: use cu_chunk instead of cu_seqlens for flash_attn during corner case where top-k equals 1#26
yibozhong wants to merge 1 commit intoMoonshotAI:masterfrom
yibozhong:master

Commits