A new technique ["Cautious Weight Decay"](https://arxiv.org/abs/2510.12402) has been recently proposed, which looks relevant to this repository.