Streaming Agents

[hwchase17]

We're working on improving streaming from agents. If there was an agent.stream method, what would you want it to return/want to be able to configure it to return?

• All tokens from LLM
• All tools called
• All observations of those actions

[homanp]

Basically the three points you have in your posts are must-haves but I would add framework-wrappers similar to the ones you have for Streamlit as an example.

Wrappers for popular frameworks such as FastAPI so that users don't have to reinvent the wheel here. It is a fairly simple thing but easy to get wrong. This

[maziyarpanahi]

Being able to stream the observations would be very helpful