Search Results for author: Farshed Abdukhakimov

Found 2 papers, 2 papers with code

SANIA: Polyak-type Optimization Framework Leads to Scale Invariant Stochastic Algorithms

1 code implementation • 28 Dec 2023 • Farshed Abdukhakimov, Chulu Xiang, Dmitry Kamzolov, Robert Gower, Martin Takáč

Adaptive optimization methods are widely recognized as among the most popular approaches for training Deep Neural Networks (DNNs).

2

Paper
Code

Stochastic Gradient Descent with Preconditioned Polyak Step-size

1 code implementation • 3 Oct 2023 • Farshed Abdukhakimov, Chulu Xiang, Dmitry Kamzolov, Martin Takáč

Stochastic Gradient Descent (SGD) is one of the many iterative optimization methods that are widely used in solving machine learning problems.

2

Paper
Code

Cannot find the paper you are looking for? You can Submit a new open access paper.