How to change the directory where the model will get loaded to in SageMaker

[FarziBuilder]

Hey my root directory only has 30 Gb of free storage, while the EBS volume that I added has 500 Gb of free storage.

I want that the model should be stored in the EBS volume added NOT in root directory.

But, I am unable to figure out how to change the storage location in vLLM

[zhuohan123]

You can use the --download-dir option to specify your model cache path.