automatic handling of rate limit failures #3708
fixerivan
started this conversation in
Feature Requests
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
i am getting a lot of rate limit failures on amazon bedrock
it looks like this:
Too many tokens, please wait before trying again.
Error: Request was throttled or rate limited. Please try:
Reducing the frequency of requests
If using a provisioned model, check its throughput settings
Contact AWS support to request a quota increase if needed
message: Too many tokens, please wait before trying again.
name: ThrottlingException
$fault: client
$metadata: {"httpStatusCode":429,"requestId":"98aa8bc3-96e8-4d2b-97a1-7697cece3520","attempts":3,"totalRetryDelay":380}
$response: {"statusCode":429,"headers":"[Object]","body":"[Object]"}
right now this is NOT handled by Roo Code at all, it just waits for the use to click resume task
this should be automated
Beta Was this translation helpful? Give feedback.
All reactions