Replies: 1 comment 1 reply
-
If I remember correctly, installing vllm first and then installing flashinfer will avoid torch conflict. |
Beta Was this translation helpful? Give feedback.
1 reply
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Installing FlashInfer automatically installs Torch 2.4, while installing VLLM automatically installs Torch 2.5.1. It's quite frustrating.
Beta Was this translation helpful? Give feedback.
All reactions