1 code implementation • 23 Feb 2020 • D. Kafka, Daniel. N. Wilke
Step sizes in GOLS are determined by localizing Stochastic Non-Negative Associated Gradient Projection Points (SNN-GPPs) along descent directions.
no code implementations • 15 Jan 2020 • Dominic Kafka, Daniel. N. Wilke
This study proposes gradient-only line searches to resolve the learning rate for neural network training algorithms.
no code implementations • 15 Sep 2019 • Younghwan Chae, Daniel. N. Wilke
An empirical study is conducted where function and derivative information are enforced in various ways for the quadratic approximations.