Can Convert to GGUF use multi-core? #4262
-
This is when using convert.py. Is it possible to speed up the conversion from Hugging Face Model to GGUF by utilizing multi-cores? There are mainly three things I would like to ask:
Thank you! |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
The conversion should mostly be limited in memory and disk speed, adding more cores is typically reducing performance not increasing it in these circumstances. |
Beta Was this translation helpful? Give feedback.
The conversion should mostly be limited in memory and disk speed, adding more cores is typically reducing performance not increasing it in these circumstances.
Quantizing is a step that is more compute intense and that tool already supports multi core processing