Skip to content

Commit 8bda51f

Browse files
committed
add mc2 mask
Signed-off-by: weiguihua2 <weiguihua2@huawei.com>
1 parent c4e6875 commit 8bda51f

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm_ascend/attention/mla_v1.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -511,8 +511,8 @@ def build(
511511
num_reqs_pad_size]
512512
else:
513513
seq_lens_list = seq_lens.tolist()
514-
mc2_mask = self.generate_activate_mask(num_actual_tokens,
515-
num_reqs + num_reqs_pad_size)
514+
mc2_mask = self.generate_activate_mask(
515+
num_actual_tokens, num_reqs + num_reqs_pad_size)
516516

517517
decode_metadata = AscendMLADecodeMetadata(
518518
input_positions=input_positions,

0 commit comments

Comments
 (0)