How to get logprobs from openai? #7550
Unanswered
ewvikienkr
asked this question in
Questions
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
input
Output
{'replies': ['Hello! How can I assist you today?'], 'meta': [{'model': 'gpt-3.5-turbo-0125', 'index': 0, 'finish_reason': 'stop', 'usage': {'completion_tokens': 9, 'prompt_tokens': 9, 'total_tokens': 18}}]}
As you can see logprobs nor top_logprobs are included even though they are supported parameters https://platform.openai.com/docs/api-reference/chat/create?lang=python.
Am I doing something wrong or is this actually not supported?
Beta Was this translation helpful? Give feedback.
All reactions