Skip to content

Commit ec668c3

Browse files
committed
Address comment: change pplx id type to int32
Signed-off-by: Ming Yang <yming@meta.com>
1 parent 6ca83a4 commit ec668c3

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/layers/fused_moe/pplx_prepare_finalize.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -81,7 +81,7 @@ def max_num_tokens_per_rank(self) -> Optional[int]:
8181
return self.max_num_tokens
8282

8383
def topk_indices_dtype(self) -> Optional[torch.dtype]:
84-
return torch.uint32
84+
return torch.int32
8585

8686
def prepare(
8787
self,

0 commit comments

Comments
 (0)