Skip to content

Commit 09fc057

Browse files
authored
Reduce new tokens on command R+ (#1080)
1 parent bc30bd1 commit 09fc057

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

.env.template

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -10,8 +10,8 @@ MODELS=`[
1010
"logoUrl": "https://huggingface.co/datasets/huggingchat/models-logo/resolve/main/cohere-logo.png",
1111
"parameters": {
1212
"stop": ["<|END_OF_TURN_TOKEN|>"],
13-
"truncate" : 24576,
14-
"max_new_tokens" : 8192,
13+
"truncate" : 28672,
14+
"max_new_tokens" : 4096,
1515
"temperature" : 0.3
1616
},
1717
"promptExamples" : [

0 commit comments

Comments
 (0)