Tighter Lower Bounds for Shuffling SGD: Random Permutations and Beyond

1 code implementation • 13 Mar 2023 • Jaeyoung Cha, Jaewook Lee, Chulhee Yun

We study convergence lower bounds of without-replacement stochastic gradient descent (SGD) for solving smooth (strongly-)convex finite-sum minimization problems.