Support for Batching

[bso-AL]

Hello

Recently started using Prism and it works like a charm, makes interacting with the different models very elegant and the code easier to read. I ran into the use case of needing to use the Batching functionality of OpenAI for a larger data set and noticed that Prism does not provide this directly atm.

I ended up making a hacky solution with creating a Custom Provider and implementing the functionality myself(specific to OpenAI). So I was wondering if this is something that is perhaps on the roadmap or if this is out of the "scope" of the package ? Or if anyone else has made their own solution/ideas and wish to share.

Thanks in advance for any clarification and/or ideas :)

[pushpak1300]

can you please share your implementation ?