Cannot build server #7941
-
Hi, I have been trying to build the server. As silly as it sounds, I'm not sure what is the right folder. In any case I have tried following https://github.com/ggerganov/llama.cpp/blob/master/examples/server/README.md both in the main folder as well as in /examples/server. When I run:
I get
In the main folder, I'm getting:
Other than that, I have been able to use llama.cpp without issues. It is just a matter of the server. Thank you. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 2 replies
-
I have the executable in my main folder, perhaps because i compile llama.cpp with examples, LLAMA_BUILD_EXAMPLES=1:
Remove the strings, when you don't need them. I use a newer compiler, OpenBlas, ... But i think, "server" is there without building examples. |
Beta Was this translation helpful? Give feedback.
I have the executable in my main folder, perhaps because i compile llama.cpp with examples, LLAMA_BUILD_EXAMPLES=1:
make CC=/usr/bin/gcc-13 CXX=/usr/bin/g++-13 LLAMA_OPENBLAS=1 LLAMA_BUILD_EXAMPLES=1 LLAMA_BUILD_LIBS=1 LLAMA_FAST=1
Remove the strings, when you don't need them. I use a newer compiler, OpenBlas, ...
On my system with newest llama.cpp source, make llama-server works too.
But i think, "server" is there without building examples.