Search Results for author:
Found 2 papers, 1 papers with code
AdaScale SGD: A User-Friendly Algorithm for Distributed Training
When using large-batch training to speed up stochastic gradient descent, learning rates must adapt to new batch sizes in order to maximize speed-ups and preserve model quality.
AdaScale SGD: A Scale-Invariant Algorithm for Distributed Training
When using distributed training to speed up stochastic gradient descent, learning rates must adapt to new scales in order to maintain training effectiveness.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
