Support concurrent tool call streaming with ID-based tracking

[koxudaxi]

TL;DR

Added support for parallel tool calls in streaming responses by tracking tool calls by ID.

What changed?

• Added an id field to ToolCallChunk and ToolCallEndChunk classes to uniquely identify tool calls
• Modified the stream response handler to track tool calls by ID in a dictionary (_current_tool_calls_by_id)
• Updated the tool call handling logic to support processing multiple tool calls in parallel
• Updated error messages to be more specific about which tool call ID is causing issues
• Updated all test cases to include the required ID field in tool call chunks

How to test?

• Run the existing test suite to verify that all tool call functionality works correctly
• Test scenarios with multiple concurrent tool calls to ensure they are properly tracked and processed
• Verify error handling by testing with unknown tool call IDs

Why make this change?

This change enables proper handling of parallel tool calls in streaming responses. By tracking tool calls by their unique IDs rather than using a single _current_content reference, the system can now process multiple tool calls simultaneously without losing track of their state. This is particularly important for complex interactions where multiple tools might be called in parallel by the LLM.

[cloudflare-workers-and-pages]

Deploying with    Cloudflare Workers

The latest updates on your project. Learn more about integrating Git with Workers.

Status	Name	Latest Commit	Updated (UTC)
✅ Deployment successful! View logs	v2-docs	baa82ae	Oct 29 2025, 02:38 PM

[koxudaxi]

Warning

This pull request is not mergeable via GitHub because a downstack PR is open. Once all requirements are satisfied, merge this PR as a stack on Graphite.
Learn more

• Add unittest for GrokClient #1467
• Implement the GrokClient #1466
• Support concurrent tool call streaming with ID-based tracking #1468 👈 (View in Graphite)
• Add unittest for mirrored provider clients (AnthropicVertex) #1465
• Implement mirrored provider clients (AnthropicVertex) #1464
• Add unittest for mirrored provider clients (AnthropicBedrock) #1455
• Implement mirrored provider clients (AnthropicBedrock) #1454
• Implement mirrored provider clients (AzureOpenAI) #1439
• Add public provider property to BaseClient #1441
• Clean up VCRConfig by replacing filter_headers with sanitization hook #1461
• v2

This stack of pull requests is managed by Graphite. Learn more about stacking.