Skip to content

Enable/refine reasoning support #9700

@anakin87

Description

@anakin87

In #9696, we added the ReasoningContent field to ChatMessage for storing model's reasoning.

For each ChatGenerator that explicitly supports reasoning-capable models, we should do the following:

  • Verify whether init/run parameters allow reasoning settings. If not, add them.
  • Refactor internal methods to ensure that reasoning is stored in the new field (not in meta).
  • At runtime, handle reasoning content appropriately: some providers require removing reasoning from previous messages, while others require including it.
  • Check how reasoning works with tool calls. Several providers have special requirements (e.g., using reasoning signatures).
  • Check that when streaming is enabled, the reasoning content is successfully returned in the final assistant message. (For the moment, I have the impression that we cannot support streaming reasoning in a unified way).

Most child issues should wait until the 2.17.0 release (which will include the new field).

The list of child issues might not be comprehensive. If I forgot some relevant ChatGenerator, feel free to add it.

Sub-issues

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Medium priority, add to the next sprint if no P1 available

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions