multiple requests #811
Unanswered
jannikstdl
asked this question in
Q&A
multiple requests
#811
Replies: 1 comment
-
|
That's what I was thinking too, considering ggml models are not thread-safe |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Can LocalAI handle multiple requests at the same time?
Beta Was this translation helpful? Give feedback.
All reactions