Replies: 1 comment
-
It hasn't been implemented yet - PRs welcome |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
In my experiments, I have lots of different checkpoints that I wanna try, and of course they are using the same tokenizer. In pytorch, it is not a problem to set a static tokenizer path and investigate different checkpoints, but when trying to convert to gguf with llama.cpp's script, it always wanna see the tokenizer in the same directory as the checkpoint and I have to copy the tokenizer once and once again. why not provide the converter an optional arg and let the same dir as a default option?
Beta Was this translation helpful? Give feedback.
All reactions