Function call

[alelordelo]

Is it possible to run function calls, like on OpenAI assistants api?

[alelordelo]

I am new to Llama and MLX (currently using openAI Assistants API), so I did some research and found that Llama 3.2 can do function/tool calls:
https://www.llama.com/docs/model-cards-and-prompt-formats/llama3_2/

I did a first test with the prompt mentioned on the example above, and it seems to work. It also returns this info:

Should you decide to return the function call(s), Put it in the format of [func1(params_name=params_value, params_name2=params_value2...), func2(params)]
NO other text MUST be included.<|eot_id|><|start_header_id|>assistant<|end_header_id|>

Now I am trying to figure out how to:

• differentiate a tool call that a regular message
• pass this function arguments and save to core data

If anyone has insights how to do this, I highly appreciate!

tks

[alelordelo]

update, Jinja template now supports function calls:

ml-explore/mlx-swift-examples#174
johnmai-dev/Jinja#8