This repository was archived by the owner on Oct 9, 2023. It is now read-only.
Exclude parameters from weight decay #1461
Unanswered
rohan-mehta-1024
asked this question in
Data / pipelines
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I am wondering how to exclude parameters from weight decay when using LARS? Do I have to manually annotate the parameters somehow? I have looked at the source code for the LARS optimizer but am still confused.
Beta Was this translation helpful? Give feedback.
All reactions