Skip to content

Commit b6f961f

Browse files
authored
Update model_runner_v1.py
1 parent d56abb8 commit b6f961f

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/worker/model_runner_v1.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -821,7 +821,7 @@ def get_spec_token_ids(
821821
num_scheduled_tokens: int,
822822
hidden_states: torch.Tensor,
823823
attn_metadata: SpecDecodeMetadata,
824-
) -> list[list[int]]:
824+
) -> Optional[list[list[int]]]:
825825
if not self.use_spec_decode:
826826
# Speculative decoding is not enabled.
827827
spec_token_ids = None

0 commit comments

Comments
 (0)