Skip to content

Commit 1423512

Browse files
Isotr0pydtrifiro
authored andcommitted
disable using CacheTokenizer for transformers >= 4.53.0
fixes vllm-project#20224 addendum to vllm-project#20244
1 parent 7dd12da commit 1423512

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/inputs/registry.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -133,7 +133,7 @@ def get_hf_processor(
133133
# Transformers 4.53.0 has issue with passing tokenizer to
134134
# initialize processor. We disable it for this version.
135135
# See: https://github.com/vllm-project/vllm/issues/20224
136-
if Version(TRANSFORMERS_VERSION) != Version("4.53.0"):
136+
if Version(TRANSFORMERS_VERSION) < Version("4.53.0"):
137137
kwargs["tokenizer"] = self.tokenizer
138138
return super().get_hf_processor(
139139
typ,

0 commit comments

Comments
 (0)