Automatic Function Calling For CohereForAI/c4ai-command-r-plus-08-2024 #8958
tomer150178
announced in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I deployed the model c4ai-command-r-plus-08-2024 locally based on VLLM.
I would like to enable the Automatic Function Calling feature, so I set the following flags:
--enable-auto-tool-choice
--chat-template [path/to/local/tokenizer_config.json]
As described in the documentation, I need to define another flag: --tool-call-parser, but there is no option for the Command-R-Plus model from Cohere (the available options are: hermes, mistral, or llama3_json).
Could you please help me find a solution for this issue?
Beta Was this translation helpful? Give feedback.
All reactions