Hardware specification #9
Description
Hi @jondurbin Thanks for sharing the bagel model. What kind of hardware specification for DPO trainning? Your DPO training is based on Lora but not full parameters, am I right?
{{ message }}
Hi @jondurbin Thanks for sharing the bagel model. What kind of hardware specification for DPO trainning? Your DPO training is based on Lora but not full parameters, am I right?