docs/how_to/tool_streaming/

[giscus[bot]]

docs/how_to/tool_streaming/

When tools are called in a streaming context,

https://python.langchain.com/docs/how_to/tool_streaming/

[Giambapisasale]

Here we are missing how to stream the toolsMessage content! I want to write a tool that stream the result with
yield "partial response"
and send the "partial response" ToolChunkMessage. How to?

[mdrxy]

I'd suggest checking out this tutorial. A background on the Runnable interface may help too.

[kdyzm]

It's very strange, my output is as follows:

[]
[{'name': 'multiply', 'args': None, 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a":', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": ', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 1', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': None, 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1,', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "b', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "b":', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "b": ', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "b": 4', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "b": 49', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "b": 49}', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "b": 49}', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]
[{'name': 'multiply', 'args': '{"a": 12}', 'id': 'chatcmpl-tool-83af3bd592324ffab2530e6b389c0acd', 'index': 0, 'type': 'tool_call_chunk'}, {'name': 'add', 'args': '{"a": 1, "b": 49}', 'id': 'chatcmpl-tool-f236b1fdb4724396a6ea9a0dd8c5fcf1', 'index': 1, 'type': 'tool_call_chunk'}]

Process finished with exit code 0

Parameter error, it's obviously 3 multiplied by 12 and 11 plus 49，but in the streaming output, almost all the parameters given are wrong.Even if i change the model, it's still the same.

What could be the problem?