Skip to content

Commit 73ff936

Browse files
committed
Update DeepSeek-V2-Lite accuracy base line
Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
1 parent cf26a50 commit 73ff936

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

tests/long_term/test_deepseek_v2_lite_tp2_accuracy.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -34,8 +34,7 @@
3434
# 3% relative tolerance for numerical accuracy.
3535
RTOL = 0.03
3636
# Baseline accuracy after VLLM optimization.
37-
# FIXME: fix the accuracy issue
38-
EXPECTED_VALUE = 0.000758150113722517
37+
EXPECTED_VALUE = 0.3843821076573162
3938

4039

4140
def run_test(model_name, queue, more_args=None):

0 commit comments

Comments
 (0)