What kind of function is EXTRA_BACKEND? #2021
Unanswered
Taikono-Himazin
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Someone please tell me.
It says EXTRA_BACKEND. https://localai.io/advanced/#extra-backends
Is this mechanism a way to improve performance?
For example, can I add two llama.cpp backends and handle requests in parallel?
Can LocalAI act as a load balancer?
Beta Was this translation helpful? Give feedback.
All reactions