【开源实习】Barthez模型微调 #2032

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

SeasonMay wants to merge 1 commit into mindspore-lab:master from SeasonMay:master

Contributor

SeasonMay commented May 4, 2025

barthez 模型微调

任务

任务编号：IAUOXG
任务链接：https://gitee.com/mindspore/community/issues/IAUOXG
模型：moussaKam/barthez
数据集: Allocine 法语情感分类数据集

结果对比：

mindnlp+910b
·mindnlp==0.4.1
·mindspore==2.5.0

Epoch	train_loss	eval_loss	f1_score
1	0.2217	0.1630	0.9432
2	0.1782	0.1563	0.9453
3	0.1661	0.1582	0.9469
4	0.1582	0.1542	0.9503
5	0.1522	0.1499	0.9509

pytorch+3090

Epoch	train_loss	eval_loss	f1_score
1	0.2468	0.1690	0.9427
2	0.1833	0.1586	0.9450
3	0.1685	0.1611	0.9443
4	0.1605	0.1559	0.9471
5	0.1543	0.1522	0.9499


          【开源实习】Barthez模型微调

514c521

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet