Skip to content

Commit f92734e

Browse files
committed
fix scalar scales shape in make_quantized_test_activations
Signed-off-by: Bill Nell <bnell@redhat.com>
1 parent dcf59cf commit f92734e

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed

tests/kernels/moe/utils.py

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -166,6 +166,9 @@ def make_quantized_test_activations(
166166
a[e], None, use_per_token_if_dynamic=per_act_token_quant)
167167
a_scale = torch.stack(a_scale)
168168

169+
if not per_act_token_quant and block_shape is None:
170+
a_scale = a_scale.view(E, 1, 1)
171+
169172
return a, a_q, a_scale
170173

171174

0 commit comments

Comments
 (0)