Skip to content

Commit a4126f3

Browse files
author
weijinqian_v1
committed
[Feature]Moe alltoallv communication optimization for unquantized RL training sence & alltoallv support dpo
Signed-off-by: weijinqian_v1 <weijinqian@huawei.com>
1 parent cf3f1c8 commit a4126f3

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm_ascend/ops/moe_dispatcher/token_dispatcher.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -190,7 +190,7 @@ def __init__(self, config: MoeDispatcherConfig):
190190
for i in range(len(self.local_expert_indices) - 1):
191191
assert (
192192
self.local_expert_indices[i] == self.local_expert_indices[i + 1] - 1
193-
), "local_expert_indices must be continous"
193+
), "local_expert_indices must be continuous"
194194
self.probs = None
195195
self.input_splits = None
196196
self.output_splits = None

0 commit comments

Comments
 (0)