[Feature Request] Preliminary research on tool message management #3136
Description
Required prerequisites
- I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
- Consider asking first in a Discussion.
Motivation
We believe that at the current stage, managing messages properly within tools is very important. For example, in the case of browser use, tool usage may lead to extremely long contexts. Using tabs could be a good approach—for instance, letting the model only keep track of open pages, while closed pages are not stored in memory. Similarly, for the terminal toolkit, repeatedly using shell_view may also result in duplicated and overly long contexts.
We hope to find a method that can prevent these tools from introducing repetitive and excessively long contexts without disrupting the KV cache. Therefore, we encourage any interested community members to conduct some preliminary research and share suggestions with us.
Solution
No response
Alternatives
No response
Additional context
No response