You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
🚀 Test loss curves against a reference implementation like huggingface for a large number of steps like 1000 steps.
The reference loss should come from a separate implementation (It can come from running huggingface models on GPUs or TPUs). Probably generate a loss file by running a cron job weekly and compare our implementation against the loss curve nightly for any regressions.
The text was updated successfully, but these errors were encountered:
🚀 Test loss curves against a reference implementation like huggingface for a large number of steps like 1000 steps.
The reference loss should come from a separate implementation (It can come from running huggingface models on GPUs or TPUs). Probably generate a loss file by running a cron job weekly and compare our implementation against the loss curve nightly for any regressions.
The text was updated successfully, but these errors were encountered: