Skip to content

Files

Latest commit

 

History

History

On_the_Variance_of_the_Adaptive_Learning_Rate_and_Beyond

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

On the Variance of the Adaptive Learning Rate and Beyond

Implementation in 100 lines of code of the paper RAdam.

Usage

$ pip3 install -r requirements.txt
$ python3 radam.py

Results

Test accuracy