Skip to content

Commit d9cdbe3

Browse files
committed
Address comment: revert type change for deepep_ll for now
1 parent ec668c3 commit d9cdbe3

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/layers/fused_moe/deepep_ll_prepare_finalize.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -65,7 +65,7 @@ def max_num_tokens_per_rank(self) -> Optional[int]:
6565
return self.max_tokens_per_rank
6666

6767
def topk_indices_dtype(self) -> Optional[torch.dtype]:
68-
return torch.int32
68+
return torch.int64
6969

7070
def _do_quant(
7171
self,

0 commit comments

Comments
 (0)