The withStreamUsage() of the OpenAiChatOptions is not supported in AzureOpenAiChatOptions.

[hy4470]

When using Azure OpenAI, the 'usage' metadata is always returned as empty in the stream().

I understand that 'usage' is supported in the latest OpenAIServiceVersion, V2024_08_01_PREVIEW. Therefore, the AzureOpenAiChatOptions should also support the withStreamUsage() method to align with this.

[garethjevans]

Related Issue: Azure/azure-sdk-for-java#40998

[andresssantos]

Can we implement this feature now that the issue in the Azure SDK has been resolved?

[markpollack]

@andresssantos yes, it seems like this should be possible if you want to take a look, that would be appreciated.

[andresssantos]

@markpollack, opened PR #2858.

This is my first PR for Spring projects, please feel free to review and share any feedback or suggestions for improvement. I’m open to making adjustments as needed.

[markpollack]

closing issue as it has been resolved