How to control the number of rounds of messages that are sent to LLM? #335
Answered
by
boyangsvl
yinshuofan
asked this question in
Q&A
-
|
For example, when a user has completed some conversations with an LLM, to ensure the LLM's performance I need to control the rounds of chat history. How can I do that? |
Beta Was this translation helpful? Give feedback.
Answered by
boyangsvl
May 3, 2025
Replies: 1 comment
-
|
You can trim the history in before_model_callback. |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
boyangsvl
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
You can trim the history in before_model_callback.