Skip to content

Commit 6f985e9

Browse files
sakura-umijordankanter
authored andcommitted
server : fix OpenAI server sampling w.r.t. penalty. (ggml-org#4675)
1 parent 5dcf4e5 commit 6f985e9

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/server/server.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2461,7 +2461,7 @@ json oaicompat_completion_params_parse(
24612461
llama_params["mirostat_eta"] = json_value(body, "mirostat_eta", default_sparams.mirostat_eta);
24622462
llama_params["penalize_nl"] = json_value(body, "penalize_nl", default_sparams.penalize_nl);
24632463
llama_params["typical_p"] = json_value(body, "typical_p", default_sparams.typical_p);
2464-
llama_params["repeat_last_n"] = json_value(body, "repeat_last_n", 0);
2464+
llama_params["repeat_last_n"] = json_value(body, "repeat_last_n", default_sparams.penalty_last_n);
24652465
llama_params["ignore_eos"] = json_value(body, "ignore_eos", false);
24662466
llama_params["tfs_z"] = json_value(body, "tfs_z", default_sparams.tfs_z);
24672467

0 commit comments

Comments
 (0)