Ranger21: a synergistic deep learning optimizer

2 code implementations • 25 Jun 2021 • Less Wright, Nestor Demeure

As optimizers are critical to the performances of neural networks, every year a large number of papers innovating on the subject are published.