-
I just noticed "WizardLM 13B Uncensored" appeared in the wild But I'm still trying to work out the correct process of conversion for "pytorch_model.bin" in to GGML (while I continue reading through all docs and experiment) EDIT: |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 4 replies
-
Simply run the |
Beta Was this translation helpful? Give feedback.
Simply run the
convert.py
pointing to the directory you put the files.then run the
qunatize
executable for the desired quantization.done.