Does Prism support Azure implementation? (OpenAI, RAG, ...)

[VerheeckeLorenzo]

As the title cites, I was wondering if the Prism package also supports connecting to an OpenAI text/embedding model hosted on Azure?

[sixlive]

It should! I just signed up for an Azure account. I'll test things out and circle back!

[avengerweb]

Any updates on this one? it is compatible.
Difference is, you need to have url with model name and "api-version" in query param. It is pretty small change, I think you should add config ('is_azure') in configuration

https://github.com/prism-php/prism/blob/main/src/Providers/OpenAI/Handlers/Text.php#L108

return $this->client->post($request->model() . '/chat/completions?api-version=' . config('openai.azure_version'),

[VerheeckeLorenzo]

I think it would be best to keep those two seperated. Azure OpenAI might not be too different from OpenAI's official's implementation (API), but this could maybe change in the future, no? Also: Azure supports RAG/other cloud solutions that might be cool to implement in this package. Just sharing my thoughts here ^^

[avengerweb]

Even official SDK do not separate them. Even though there indeed could be more features, adding simple flag is much faster then implement whole provider from scratch.
Plus, API of azure has versioning support, it will not just suddenly changed.

[ChrisB-TL]

For the soon to be released Bedrock provider we've fallen somewhere between the two.

For this, to future proof, it probably makes sense to have a separate provider with its own client and config but using the existing openai handlers - rather than a config flag. Not much extra effort.

[mafrasil]

Any developments about supporting Azure?