client.chat.completions.create: how to add response_format

[jsmith173]

Please extend the call with response_format. I want JSON only.

			response = client.chat.completions.create(
				model=self.config['model_actual'],
				messages=self.messages,
				stream=stream,
				n=1,
				frequency_penalty=0,
				presence_penalty=0,
				seed=12345,
				top_p=0.1,
				max_tokens=max_tokens
			)

[dosubot[bot]]

To add the response_format parameter to your client.chat.completions.create call and specify JSON as the format, you can modify your code like this:

response = client.chat.completions.create(
    model=self.config['model_actual'],
    messages=self.messages,
    stream=stream,
    n=1,
    frequency_penalty=0,
    presence_penalty=0,
    seed=12345,
    top_p=0.1,
    max_tokens=max_tokens,
    response_format={"type": "json_object"}
)

This sets the response_format to a JSON object, which should ensure that the response is formatted as JSON ^[1].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Other}