Issue Passing Database Path to Llama.cpp Server #7665
Unanswered
SeanZhang7
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I'm trying to pass a database file path to the server built from llama.cpp/examples/server. Here is the command I am using:
./server -m ./models/codellama-34b-instruct.Q4_K_M.gguf --path /tmp/test/llama.cpp/examples/server/public/users.db -c 8192
-t 20 --threads-http 20 --host 0.0.0.0 --port 8088 &
When I try to access the public path using sparams.public_path, I encounter an error saying that sparams has no attribute public_path. This is confusing because in the server_params_parse function, sparams.public_path is updated.
Has anyone encountered a similar issue or have any idea what might be going wrong?
server_params_parse:

How I access public_path:

Beta Was this translation helpful? Give feedback.
All reactions