We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 42f8e40 commit 82382cfCopy full SHA for 82382cf
vllm/platforms/rocm.py
@@ -247,10 +247,6 @@ def set_device(cls, device: torch.device) -> None:
247
Set the device for the current platform.
248
"""
249
torch.cuda.set_device(device)
250
- # With this trick we can force the device to be set eagerly
251
- # see https://github.com/pytorch/pytorch/issues/155668
252
- # for why and when it is needed
253
- _ = torch.zeros(1, device=device)
254
255
@classmethod
256
@lru_cache(maxsize=8)
0 commit comments