feat(aws_base_llm.py): prevents recreating boto3 credentials during high traffic#5704

Closed

krrishdholakia wants to merge 7 commits intomainfrom

litellm_dev_14_09_2024_v2

Commits on Sep 15, 2024

feat(aws_base_llm.py): prevents recreating boto3 credentials during high traffic
krrishdholakia
committed
fix(base_aws_llm.py): fix credential caching check to see if token is set
krrishdholakia
committed
refactor(bedrock/chat): separate converse api and invoke api + isolate converse api transformation logic
krrishdholakia
committed
fix: fix imports
krrishdholakia
committed
fix(bedrock/embed): fix reordering of headers
krrishdholakia
committed
fix(base_aws_llm.py): fix get credential logic
krrishdholakia
committed
fix(converse_handler.py): fix ai21 streaming response
krrishdholakia
committed