Search Results for author:
Found 1 papers, 0 papers with code
O(1) Communication for Distributed SGD through Two-Level Gradient Averaging
Large neural network models present a hefty communication challenge to distributed Stochastic Gradient Descent (SGD), with a communication complexity of O(n) per worker for a model of n parameters.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
