How to use FP8 for SYCL building? #11527
Unanswered
GermanAizek
asked this question in
Q&A
Replies: 1 comment
-
As far as I can see no backends in llama.cpp support fp8. See this related discussion: #8780 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Is there FP8 support at the moment, documentation only mentions FP16.
Beta Was this translation helpful? Give feedback.
All reactions