I have started a web service, and when I use the OpenAI standard interface for calling, according to the printed logs, I am not receiving the relevant parameters. #8453
Unanswered
chenbingweb
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I have started a web service, and when I use the OpenAI standard interface for calling, according to the printed logs, I am not receiving the relevant parameters.
./llama-server -m /gemini/pretrain/qwen2-7b-instruct-q2_k.gguf -c 2048 -ngl 29
Beta Was this translation helpful? Give feedback.
All reactions