Skip to content

Commit 49d92f5

Browse files
committed
make mask contiguous
Signed-off-by: Yannick Schnider <yannick.schnider1@ibm.com>
1 parent c8a33de commit 49d92f5

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_spyre/v1/worker/spyre_model_runner.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -727,7 +727,7 @@ def _prepare_prompt(
727727
self.pad_input_ids(input_token_list,
728728
min_pad_left=left_padding,
729729
min_pad_right=block_padding)
730-
mask = mask.unsqueeze(1)
730+
mask = mask.unsqueeze(1).contiguous()
731731

732732
# not needed for prefill
733733
current_tkv_mask = None

0 commit comments

Comments
 (0)