no code implementations • 1 Jan 2023 • Albert S. Berahas, Miaolan Xie, Baoyu Zhou
A step-search sequential quadratic programming method is proposed for solving nonlinear equality constrained stochastic optimization problems.
no code implementations • 14 Jun 2022 • Aaron Defazio, Baoyu Zhou, Lin Xiao
The classical AdaGrad method adapts the learning rate by dividing by the square root of a sum of squared gradients.
1 code implementation • 20 Jul 2020 • Albert Berahas, Frank E. Curtis, Daniel P. Robinson, Baoyu Zhou
It is assumed in this setting that it is intractable to compute objective function and derivative values explicitly, although one can compute stochastic function and gradient estimates.