Optimizers: deepmind/optax Discussions now open 👋

[8bitmp3]

https://github.com/deepmind/optax/discussions are now open (by @mtthss)

Optax is a gradient processing and optimization library for JAX.

Optax is designed to facilitate research by providing building blocks that can be easily recombined in custom ways.

Our goals are to:

• provide simple, well-tested, efficient implementations of core components.
• improve research productivity by enabling to easily combine low level ingredients into custom optimisers (or other gradient processing components).
• accelerate adoption of new ideas by making it easy for anyone to contribute.

Docs: optax.readthedocs.io

The following optimizers should work "out of the box": AdaBelief, Adagrad, Adam, AdamW, Fromage, Lamb, Noisy SGD, RAdam, RMSprop, SGD, Yogi, DPSGD.