Easy way to make llama_cpp.server available on local net? #353
Replies: 2 comments
-
see #315 set HOST='external IP of your OS' |
Beta Was this translation helpful? Give feedback.
0 replies
-
Great, Thanks! |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi, I am aware I can clone the repo and modify
llama_cpp/server/__main__.py
to changelocalhost
to0.0.0.0
, etc but as I would prefer not to do that and am usingpip install llama-cpp-python
to stay up to date with the package:What is the easiest way to make the llama-cpp API server available on the local net with out breaking the
pip install
method?Beta Was this translation helpful? Give feedback.
All reactions