You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
remove LR limits of 1.0 for optmizers like prodigy plus schedule free - also please update your requirements with updated versions of prodigy and prodigy schedule free optimizers
#3226
Please remove the LR limits of 1.0 in the GUI. Maybe put a warning instead of a hard stop.
Some optimizers like prodigy plus schedule free (which default at 1.0) can actually go above that.
someone on the sd-scripts side suggested to use a learn rate of 10 for prodigy plus schedule free but the GUI limits it to 1.
also unrelated please update your requirements with updated versions of prodigy and prodigy schedule free optimizers
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Please remove the LR limits of 1.0 in the GUI. Maybe put a warning instead of a hard stop.
Some optimizers like prodigy plus schedule free (which default at 1.0) can actually go above that.
someone on the sd-scripts side suggested to use a learn rate of 10 for prodigy plus schedule free but the GUI limits it to 1.
also unrelated please update your requirements with updated versions of prodigy and prodigy schedule free optimizers
Maybe remove the limit and put a warning instead?
LoganBooker/prodigy-plus-schedule-free#14
specifically the unet_lr in lora_gui.py but also the learn rates in class_basic_training.py have hardcoded limits of 1.0.
Beta Was this translation helpful? Give feedback.
All reactions