Skip to content

Commit 2b21e0d

Browse files
correctness
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
1 parent 53e54da commit 2b21e0d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/v1/spec_decode/eagle.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -255,7 +255,7 @@ def prepare_inputs(
255255
device = common_attn_metadata.query_start_loc.device
256256
query_start_loc_cpu = common_attn_metadata.query_start_loc_cpu
257257
spec_seq_lens_cpu =\
258-
common_attn_metadata.seq_lens_cpu - num_rejected_tokens
258+
common_attn_metadata.seq_lens_cpu - num_rejected_tokens + 1
259259

260260
# [0, a, a + b, a + b + c] -> [a, b, c]
261261
query_len_per_req = (query_start_loc_cpu[1:] -

0 commit comments

Comments
 (0)