How to implement rabbitmq on BentoML ? #4179
Unanswered
congdaoduy298
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Hi community,
Currently, I'm using BentoML to deploy my model and when I sent multiple requests I got this error: "bentoml.exceptions.ServiceUnavailable: Service Busy". I found this topic that said BentoML queues the RESTful requests #2242 but I don't know why some of my requests got the above error. How can I fix it or how can I implement something like rabbitmq to distribute requests ?
Thank you for your help.
Beta Was this translation helpful? Give feedback.
All reactions