-
Notifications
You must be signed in to change notification settings - Fork 2.3k
Open
3 / 83 of 8 issues completedLabels
P2Medium priority, add to the next sprint if no P1 availableMedium priority, add to the next sprint if no P1 available
Description
In #9696, we added the ReasoningContent
field to ChatMessage
for storing model's reasoning.
For each ChatGenerator
that explicitly supports reasoning-capable models, we should do the following:
- Verify whether init/run parameters allow reasoning settings. If not, add them.
- Refactor internal methods to ensure that reasoning is stored in the new field (not in
meta
). - At runtime, handle reasoning content appropriately: some providers require removing reasoning from previous messages, while others require including it.
- Check how reasoning works with tool calls. Several providers have special requirements (e.g., using reasoning signatures).
- Check that when streaming is enabled, the reasoning content is successfully returned in the final assistant message. (For the moment, I have the impression that we cannot support streaming reasoning in a unified way).
Most child issues should wait until the 2.17.0 release (which will include the new field).
The list of child issues might not be comprehensive. If I forgot some relevant ChatGenerator, feel free to add it.
Sub-issues
Metadata
Metadata
Assignees
Labels
P2Medium priority, add to the next sprint if no P1 availableMedium priority, add to the next sprint if no P1 available