Search Results for author:
Found 1 papers, 1 papers with code
A Distributed Data-Parallel PyTorch Implementation of the Distributed Shampoo Optimizer for Training Neural Networks At-Scale
It constructs a block-diagonal preconditioner where each block consists of a coarse Kronecker product approximation to full-matrix AdaGrad for each parameter of the neural network.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
