PowerInfer #4536
logikstate
started this conversation in
General
PowerInfer
#4536
Replies: 1 comment
-
|
Previous discussion is about it: #4534 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Anybody seen this? Claims to put important tensors on GPU and less important tensors on CPU for massive performance boost.
https://github.com/SJTU-IPADS/PowerInfer
Beta Was this translation helpful? Give feedback.
All reactions