ChatGPT plus with Azure OpenAI support as fallback?

[ilmarioranen]

Vibeproxy looks promising.

Personally I'd like to see this offer a tool for combining a subscription with an API key fallback, specifically for ChatGPT plus and Azure OpenAI.

I simply want the proxy to default to using my authenticated paid ChatGPT subscription and when it gets ratelimited, fallback to Azure OpenAI API key for a configurable amount of time (automatic switch to sub after time and/or test if ratelimit is still active). Azure OpenAI also needs additional variables as part of the config ("apiVersion", "deploymentId") etc.

Also, I hope to be able to use the local proxy with tools like Codex, maybe even Cursor (actually Cursor's Azure OpenAI API seems broken currently).

Would you consider adding such features?

[dalisoft]

I think this feature is out-of-scope, for your needs maybe needs those apps/projects

• https://docs.litellm.ai/docs/proxy/deploy