Skip to content

Commit 33db137

Browse files
ophilia-leeZhangYulongg
authored andcommitted
新增vLLM默认请求参数yaml
1 parent 9d6a42b commit 33db137

File tree

1 file changed

+11
-0
lines changed

1 file changed

+11
-0
lines changed
Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,11 @@
1+
top_p: 1.0
2+
temperature: 1.0
3+
metadata:
4+
min_tokens: 1
5+
max_tokens: 30721
6+
repetition_penalty: 1.0
7+
frequency_penalty: 0
8+
presence_penalty: 0
9+
skip_special_tokens: false
10+
chat_template_kwargs:
11+
enable_thinking: true

0 commit comments

Comments
 (0)