Skip to content

Commit 623e2ed

Browse files
authored
[BugFix][V1] Quick fix for min_tokens with multiple EOS (vllm-project#15407)
Signed-off-by: Nick Hill <nhill@redhat.com>
1 parent 9d72daf commit 623e2ed

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

vllm/sampling_params.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -369,8 +369,9 @@ def __post_init__(self) -> None:
369369
self.top_k = -1
370370
self.min_p = 0.0
371371
self._verify_greedy_sampling()
372+
372373
# eos_token_id is added to this by the engine
373-
self._all_stop_token_ids = set(self.stop_token_ids)
374+
self._all_stop_token_ids.update(self.stop_token_ids)
374375

375376
def _verify_args(self) -> None:
376377
if not isinstance(self.n, int):

0 commit comments

Comments
 (0)