Custom Provider schema/api type

[TonsiTT]

If I want to add a custom provider that, lets say, supports the OpenAI API schema and its methods, how do I specify that to Prism? or do I just change the openai provider baseurl in config? The docs aren't clear about that.
I know we can define the methods are self but considering the package already supports openai api schema, maybe a way to extend?

[ChrisB-TL]

Prism has just moved to OpenAI's newer Responses API - which is different to the original widely adopted OpenAI schema.

Therefore, you would need to create your own custom provider.

That said, you could use the old OpenAI provider in v0.69.0 as a starting point.

[TonsiTT]

Prism has just moved to OpenAI's newer Responses API - which is different to the original widely adopted OpenAI schema.

Therefore, you would need to create your own custom provider.

That said, you could use the old OpenAI provider in v0.69.0 as a starting point.

Thanks, will do that. But perhaps prism can keep the old API as a generic OpenAI schema to extend for new custom providers? I can see prism already had it implemented anyways and a lot of ai providers use that one as well as you yourself had said, being widely adopted and all.

otherwise everyone has to rewrite the same code for their openai schema custom providers that already existed in prism, and I think a lot of time and LoC could be saved

[ChrisB-TL]

Come to think of it, we have a provider for Mistral that is I think OpenAI compatible - so you could try to do the same with that.

If we were to "officially support" a generic openai api spec compatible provider, I think it would need to be a separate "OpenAICompatible" provider that sticks to a very vanilla implementation - which will have some limits.

If you do create a custom provider for it, perhaps you can contribute it back as a PR?

[TonsiTT]

I ended up not using that openai provider and settling on Gemini so perhaps in the future if i ever end up needing it, ill be sure to pr it here