Design suggestion for multi-agent architecture with streaming support #503
Unanswered
stiven-hidri
asked this question in
Q&A
Replies: 1 comment
-
Great point. It would be very useful if the output from the agent-as-tool could be streamed to the orchestrator in real time, rather than waiting for the entire response to be generated before the orchestrator can begin streaming it. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi! First of all, thanks for the great work on strands-agents.
I've recently implemented a single agent using the SDK, with access to a set of tools and support for streaming communication. As the complexity of my use case grows, I'm considering moving towards a multi-agent setup where agents are separated by domain.
The "agent-as-tool" pattern seemed promising, but during testing I noticed that when one agent calls another as a tool, streaming is no longer supported—the interaction becomes batch-like. This breaks a key requirement for my application, which relies heavily on real-time streaming responses.
Given this, I'd like to ask:
What is the recommended approach in the SDK for building a multi-agent system while preserving streaming communication?
Would a custom solution (e.g., a router agent that dynamically delegates tasks to the most appropriate agent) be more appropriate, or is there a pattern or capability in strands-agents that I might be overlooking? (e.g. streaming the agent-as-tool's response back to the orchestrator agent instead of returning it batch-like)
Thanks in advance for any insights or recommendations!
Beta Was this translation helpful? Give feedback.
All reactions