Skip to content

How to start evaluating models with LATM? #8

@DryPilgrim

Description

@DryPilgrim
  1. 没有SFT模型吗?
  2. 这个工作是类似COT在prompt上做工作吗?
  3. 按照论文的意思,在评测和实际工作的时候,是不是需要三个模型?
  4. LATM的prompt在哪里呀,https://github.com/ctlllll/LLM-ToolMaker/blob/main/cot-prompts/chinese_remainder_theorem.txt 这个里面并没有给出工具集,找不到chinese_remainder_theorem的工具 find_number(max_limit, divisors, remainders)

//en

  1. Is there no SFT model?
  2. Is this work similar to how COT works on prompts?
  3. According to the meaning of the paper, are three models needed during evaluation and actual work?
  4. Where is the prompt of LATM? https://github.com/ctlllll/LLM-ToolMaker/blob/main/cot-prompts/chinese_remainder_theorem.txt There is no tool set given in this, and the tool find_number of chinese_remainder_theorem cannot be found. (max_limit, divisors, remainders)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions