Skip to content

Commit b2f069e

Browse files
committed
Update sampler.py
Signed-off-by: xusong28 <xusong28@jd.com>
1 parent 466166d commit b2f069e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/layers/sampler.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1197,7 +1197,7 @@ def _get_next_prompt_tokens(
11971197
prompt_tokens = seq_data.prompt_token_ids
11981198
# +1 because we are looking for a next prompt token.
11991199
next_token_index_start = computed_len + 1
1200-
next_token_index_end = min(computed_len + query_len + 1,
1200+
next_token_index_end = min(computed_len + query_len,
12011201
len(prompt_tokens))
12021202
next_prompt_tokens = prompt_tokens[
12031203
next_token_index_start:next_token_index_end]

0 commit comments

Comments
 (0)