Is there a way to disable some parameters?

[farmboy-dev]

My company's LLM API doesn't allow some parameters such as Top-P and Frequency Penalty. (only allows max_token, stream, temperature now)

Is there a way to disable them from my end?

Thank you!

[logancyang]

It's not supported now but we should consider this. We added these extra params recently. cc @Emt-lin

[Emt-lin]

@farmboy-dev If the Top-P parameter is not modified, it has no actual value and is only used for display.

Is there a way to disable them from my end?

You can delete current model and readd again.

[farmboy-dev]

Thank you for the reply
I got this message from API response. any clues from the error message?

Connection error. more message: [{"type":"extra_forbidden","loc":["body","stream_options"],"msg":"Extra inputs are not permitted","input":{"include_usage":true}}]