关于fault_tolerance_data_collator的labels处理 #590
Unanswered
sysuprophet
asked this question in
Q&A
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
预训练脚本run_clm_pt_with_peft.py中,def group_texts(examples)函数中使用的是result["labels"] = result["input_ids"].copy(),但是到了trainer的data_collator函数fault_tolerance_data_collator中,使用的却是lable和label_ids,这两个对不上呀,数据能被正常处理吗?(labels VS label/label_ids)
Beta Was this translation helpful? Give feedback.
All reactions