Search Results for author: Vien V. Mai

Found 6 papers, 1 papers with code

Stability and Convergence of Stochastic Gradient Clipping: Beyond Lipschitz Continuity and Smoothness

no code implementations12 Feb 2021 Vien V. Mai, Mikael Johansson

We also study the convergence of a clipped method with momentum, which includes clipped SGD as a special case, for weakly convex problems under standard assumptions.

Convergence of a Stochastic Gradient Method with Momentum for Non-Smooth Non-Convex Optimization

no code implementations ICML 2020 Vien V. Mai, Mikael Johansson

This paper establishes the convergence rate of a stochastic subgradient method with a momentum term of Polyak type for a broad class of non-smooth, non-convex, and constrained optimization problems.

Anderson Acceleration of Proximal Gradient Methods

1 code implementation ICML 2020 Vien V. Mai, Mikael Johansson

We therefore propose a simple scheme for stabilization that combines the global worst-case guarantees of proximal gradient methods with the local adaptation and practical speed-up of Anderson acceleration.

Noisy Accelerated Power Method for Eigenproblems with Applications

no code implementations20 Mar 2019 Vien V. Mai, Mikael Johansson

This paper introduces an efficient algorithm for finding the dominant generalized eigenvectors of a pair of symmetric matrices.

Curvature-Exploiting Acceleration of Elastic Net Computations

no code implementations24 Jan 2019 Vien V. Mai, Mikael Johansson

This paper introduces an efficient second-order method for solving the elastic net problem.

Cannot find the paper you are looking for? You can Submit a new open access paper.