Skip to content

Commit feab23b

Browse files
Isotr0pyminpeter
authored andcommitted
[Minor] Allow redirecting model path for HfRunner in test (vllm-project#19795)
Signed-off-by: Isotr0py <2037008807@qq.com> Signed-off-by: minpeter <kali2005611@gmail.com>
1 parent d29081f commit feab23b

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

tests/conftest.py

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,7 @@
3333
from vllm.logger import init_logger
3434
from vllm.outputs import RequestOutput
3535
from vllm.sampling_params import BeamSearchParams
36+
from vllm.transformers_utils.utils import maybe_model_redirect
3637
from vllm.utils import cuda_device_count_stateless
3738

3839
logger = init_logger(__name__)
@@ -321,6 +322,7 @@ def __init__(
321322
skip_tokenizer_init: bool = False,
322323
auto_cls: type[_BaseAutoModelClass] = AutoModelForCausalLM,
323324
) -> None:
325+
model_name = maybe_model_redirect(model_name)
324326
self.model_name = model_name
325327

326328
self.config = AutoConfig.from_pretrained(

0 commit comments

Comments
 (0)