support for Bedrock Cross region inference profile from model selection drop down #798
ramammah
started this conversation in
Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Please allow for Bedrock Cross region inference profiles, in US, EU and APAC. This will allow for twice the network throughput.
If an enterprise needs to use this plugin with their own Gateway layer, is there options to add something like LiteLLM, where We can track how developers are using with some kind of custom header that this tool can inject and we can get those cost reports from liteLLM ?
Beta Was this translation helpful? Give feedback.
All reactions