Unable to use tools #14039
-
I see that GGUF files have a Jinja prompt template which builds a prompt listing any tools i add upon applying a template and i've been trying to get tools capable models like QwQ and Qwen3 to use a tool which i have configured but it never uses the tool and is unaware of the tool even when i tell it about the tool, is there something i have to call to get it to build the prompt for tool use? You can see my code in this repo: https://github.com/CommanderLake/LMStud Thanks for any help :) |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
Turns out i just had to enable Jinja when loading the model and ensure there are no blank messages. |
Beta Was this translation helpful? Give feedback.
Turns out i just had to enable Jinja when loading the model and ensure there are no blank messages.