no code implementations • 8 Nov 2019 • Karl Bäckström, Marina Papatriantafilou, Philippas Tsigas
Using the proposed models, we derive a staleness-adaptive SGD framework, MindTheStep-AsyncPSGD, for adapting the step size in an online-fashion, which provably reduces the negative impact of asynchrony.
