How to get scale / delta from quantized file? #863
Unanswered
infiniteloop97
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have created a quantized weights file from float32 .gguf file. I am try to read it using gguf reader but I am unable to find the deltas for the weight tensors? How can I extract that information from the quantized gguf file?
Beta Was this translation helpful? Give feedback.
All reactions