no code implementations • 9 Nov 2023 • Andrew Campbell, Hang Liu, Leah Woldemariam, Anna Scaglione
Recent research indicates that frequent model communication stands as a major bottleneck to the efficiency of decentralized machine learning (ML), particularly for large-scale and over-parameterized neural networks (NNs).