Search Results for author:
Found 4 papers, 0 papers with code
Logarithmic landscape and power-law escape rate of SGD
Stochastic gradient descent (SGD) undergoes complicated multiplicative noise for the mean-square loss.
Power-law escape rate of SGD
Stochastic gradient descent (SGD) undergoes complicated multiplicative noise for the mean-square loss.
Strength of Minibatch Noise in SGD
The noise in stochastic gradient descent (SGD), caused by minibatch sampling, is poorly understood despite its practical importance in deep learning.
Noise and Fluctuation of Finite Learning Rate Stochastic Gradient Descent
In the vanishing learning rate regime, stochastic gradient descent (SGD) is now relatively well understood.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
