Will 2*1080Ti Nvidia Card each of 11 GB support vLLM ? #8992
thomasjv799
announced in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have two 1080Ti Card and each card has 11 GB VRAM. However the compute capability is 6.1 while in vLLM it is said we require compute capability of 7. I haven't tried installing it but wanted to know if its possible serve vLLM in this cards.
Beta Was this translation helpful? Give feedback.
All reactions