Skip to content

定义最大token数不起作用嘛 #7

@WolfMoss

Description

@WolfMoss
SPARK_CHAT_MAX_TOKENS=4096      # V1.5取值为[1,4096], V2.0、V3.0和V3.5取值为[1,8192],默认为2048。
SPARK_CHAT_TEMPERATURE=0.5      # 取值范围 (0,1] ,默认值0.5
SPARK_CHAT_TOP_K=4              # 取值为[1,6],默认为4

这三个参数写进去就会报错

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions