When adding few shot examples for tool calling, the tool calling part of AIMessage is not getting formatted in the prompt.

[ksaurabh21]

Checked other resources

• I added a very descriptive title to this question.
• I searched the LangChain documentation with the integrated search.
• I used the GitHub search to find a similar question and didn't find it.

Commit to Help

• I commit to help with one of those options 👆

Example Code

from langchain_core.messages import AIMessage, HumanMessage, ToolMessage
from langchain_core.prompts import ChatPromptTemplate

examples = [
    HumanMessage(
        "What's the product of 317253 and 128472 plus four", name="example_user"
    ),
    AIMessage(
        "",
        name="example_assistant",
        tool_calls=[
            {"name": "Multiply", "args": {"x": 317253, "y": 128472}, "id": "1"}
        ],
    ),
    ToolMessage("16505054784", tool_call_id="1"),
    AIMessage(
        "",
        name="example_assistant",
        tool_calls=[{"name": "Add", "args": {"x": 16505054784, "y": 4}, "id": "2"}],
    ),
    ToolMessage("16505054788", tool_call_id="2"),
    AIMessage(
        "The product of 317253 and 128472 plus four is 16505054788",
        name="example_assistant",
    ),
]

system = """You are bad at math but are an expert at using a calculator. 

Use past tool usage as an example of how to correctly use the tools."""
few_shot_prompt = ChatPromptTemplate.from_messages(
    [
        ("system", system),
        *examples,
        ("human", "{query}"),
    ]
)

print(few_shot_prompt.format(query="What's the product of 317253 and 128472 plus four"))

Description

Trying to create a prompt that includes few shot example of tool calling (code included is from )

The output of this code is:

`System: You are bad at math but are an expert at using a calculator.

Use past tool usage as an example of how to correctly use the tools.
Human: What's the product of 317253 and 128472 plus four
AI:
Tool: 16505054784
AI:
Tool: 16505054788
AI: The product of 317253 and 128472 plus four is 16505054788
Human: What's the product of 317253 and 128472 plus four`

System Info

langchain-core==0.3.50; python_version >= '3.9' and python_version < '4.0'
langchain-openai==0.3.12; python_version >= '3.9' and python_version < '4.0'

[mghiasvand1]

[ksaurabh21]

Thanks for taking the time to respond. But my question is how will the llm learn (through in-context learning) which tools to call, when the AI message (in the formatted prompt) doesn't contain any information about which tool to call in which situation.

The code I have included is taken from here: https://python.langchain.com/docs/how_to/tools_few_shot/