Replies: 1 comment
-
Added in Reasoning effort possibly to come... |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Checked
Feature request
The Groq API supports a reasoning_format parameter that allows accessing the model's reasoning process separately from its final output. This is particularly useful for verification, explanation, and debugging purposes. While the current langchain_groq integration correctly passes the reasoning_format parameter to the Groq API through model_kwargs, it doesn't provide any way to access this reasoning data in the response.
Current Behavior
When using the native Groq Python SDK, we can access reasoning data like this:
However, when using the LangChain integration, even though the parameter is passed correctly, there's no way to access this reasoning data:
Motivation
I would like to request that the langchain_groq integration be updated to provide access to the reasoning data, perhaps by:
Including reasoning in the generation metadata
Adding a new property or method to access reasoning data
Supporting a callback for reasoning data in streaming mode
This would make it possible to use Groq's reasoning capabilities within the LangChain
Proposal (If applicable)
No response
Beta Was this translation helpful? Give feedback.
All reactions