Calibration data file - what are them? #13
Answered
by
turboderp
fgdfgfthgr-fox
asked this question in
Q&A
-
|
It seems like we need a calibration data file to quantize models, but what are them? Where can we get them? |
Beta Was this translation helpful? Give feedback.
Answered by
turboderp
Sep 13, 2023
Replies: 1 comment
-
|
Right, I'm going to do a little writeup on the quantizer clarifying all that. But in the meantime, it uses Parquet files for calibration data. You can find them all over HF, auto-converted from the various datasets there. For instance, here is wikitext-test, the same dataset that TheBloke seems to use for GPTQ conversions now. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
fgdfgfthgr-fox
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Right, I'm going to do a little writeup on the quantizer clarifying all that. But in the meantime, it uses Parquet files for calibration data. You can find them all over HF, auto-converted from the various datasets there. For instance, here is wikitext-test, the same dataset that TheBloke seems to use for GPTQ conversions now.