MKOR: Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 Updates

1 code implementation • NeurIPS 2023 • Mohammad Mozaffari, Sikan Li, Zhao Zhang, Maryam Mehri Dehnavi

This work proposes a Momentum-Enabled Kronecker-Factor-Based Optimizer Using Rank-1 updates, called MKOR, that improves the training time and convergence properties of deep neural networks (DNNs).

Second-order methods