Fix: use cu_chunk instead of cu_seqlens for flash_attn during corner case where top-k equals 1#26
Open
yibozhong wants to merge 1 commit intoMoonshotAI:masterfrom
Open
Fix: use cu_chunk instead of cu_seqlens for flash_attn during corner case where top-k equals 1#26yibozhong wants to merge 1 commit intoMoonshotAI:masterfrom
yibozhong wants to merge 1 commit intoMoonshotAI:masterfrom