Skip to content

Commit 888f222

Browse files
committed
set rope_scaling_factor default to auto
1 parent 25e8bff commit 888f222

File tree

1 file changed

+6
-5
lines changed

1 file changed

+6
-5
lines changed

config_templates/gretel/synthetics/navigator-ft.yml

Lines changed: 6 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -33,8 +33,9 @@ models:
3333
# Scale the base LLM's context length by this factor
3434
# using RoPE scaling to handle datasets with more
3535
# columns, or datasets containing groups with more
36-
# than a few records. You can try increasing the
37-
# rope_scaling_factor (you could first try the value 2)
38-
# if you hit an error for maximum tokens. It must be
39-
# an integer value. The default is 1 and maximum is 6.
40-
rope_scaling_factor: 1
36+
# than a few records. If set to 'auto', we will
37+
# estimate a value that's enough to cover your
38+
# dataset. Try increasing this value if you hit an
39+
# error for maximum tokens. It must be an integer
40+
# value between 1 and 6.
41+
rope_scaling_factor: auto

0 commit comments

Comments
 (0)