Azure OpenAI API instead of OpenAI API

[philippbla]

If anyone is interested in using Azure OpenAI API instead of the OpenAI API, I've been successful by using this proxy: https://github.com/stulzq/azure-openai-proxy

Once your azure-openai-proxy is running, simply update the following environment variable:
OPENAI_BASE_URL: 'http://<your_azure_openai_proxy-container_name>:8080/v1'

and adjust the OPENAI_API_KEY with your Azure API key.

I hope this will be useful to someone.

[habitoti]

Tbh, I really couldn't get this one working after trying to wrap my head around it for half a day. I switched to litellmproxy, and it has much better overall functionality (even a WebUI to do test calls of all sorts) and just worked instantly (with the same Azure parameters I tried to get the above mentioned going...).
Maybe it was all my fault (as it seems to work for you...), but I just also want to recommend this other solution. It will also track your requests going through it and can provide all sorts of statistics, budget control etc.

[philippbla]

Thanks for sharing - this looks really promising and indeed appears to be more intuitive to set up!