Skip to content

Commit c53711b

Browse files
authored
[MISC] correct copy_blocks src_to_dists param type (#19696)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
1 parent dac8cc4 commit c53711b

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

vllm/attention/ops/ipex_attn.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
# SPDX-License-Identifier: Apache-2.0
22
# SPDX-FileCopyrightText: Copyright contributors to the vLLM project
33

4-
from typing import Dict, List, Optional, Tuple
4+
from typing import List, Optional, Tuple
55

66
try:
77
import intel_extension_for_pytorch.llm.modules as ipex_modules
@@ -120,7 +120,7 @@ def forward_decode(
120120
@staticmethod
121121
def copy_blocks(
122122
kv_caches: List[torch.Tensor],
123-
src_to_dists: Dict[int, List[int]],
123+
src_to_dists: torch.Tensor,
124124
*args,
125125
) -> None:
126126
key_caches = [kv_cache[0] for kv_cache in kv_caches]

0 commit comments

Comments
 (0)