非微调,从头开始训练合成的结果是噪音 #367
GwsinTracy
started this conversation in
General
Replies: 3 comments
-
我也是这样的,现在在寻找原因,朋友,你知道怎么回事吗 |
Beta Was this translation helpful? Give feedback.
0 replies
-
两位朋友,可以请教一下怎么从头训练吗,我也想试试从头开始训练 @GwsinTracy @zazachao |
Beta Was this translation helpful? Give feedback.
0 replies
-
同问 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
同样的数据集,微调合成的结果正常;同样的数据集(20h),没有用底模(代码跟微调的一样,没有改动,只是没有放预训练模型在目录中),训练集loss也在正常的下降,但是合成的结果全是噪音,,这可能是什么原因导致的?
Beta Was this translation helpful? Give feedback.
All reactions