Accelerating HPC codes on Intel(R) Omni-Path Architecture networks: From particle physics to Machine Learning

no code implementations • 13 Nov 2017 • Peter Boyle, Michael Chuvelev, Guido Cossu, Christopher Kelly, Christoph Lehner, Lawrence Meadows

This displays how a factor of ten speedup in strongly scaled distributed machine learning could be achieved when synchronous stochastic gradient descent is massively parallelised with a fixed mini-batch size.

BIG-bench Machine Learning