How to only download model without serving it? #11524
yardenshoham
announced in
Q&A
Replies: 1 comment
-
I think you can use |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently I run
vllm serve
and look at~/.cache/huggingface
to get the model. I cancelvllm serve
once it started. Is there somevllm pull
command?Beta Was this translation helpful? Give feedback.
All reactions