no code implementations • ICML 2020 • Zehua Lai, Lek-Heng Lim
Stochastic optimization algorithms have become indispensable in machine learning.
no code implementations • ICML 2020 • Zehua Lai, Lek-Heng Lim
Stochastic optimization algorithms have become indispensable in machine learning.
no code implementations • 30 Dec 2022 • Xi Chen, Zehua Lai, He Li, Yichen Zhang
With the fast development of big data, it has been easier than before to learn the optimal decision rule by updating the decision rule recursively and making online decisions.
no code implementations • 28 Nov 2022 • Minda Zhao, Zehua Lai, Lek-Heng Lim
Is it possible for a first-order method, i. e., only first derivatives allowed, to be quadratically convergent?
no code implementations • 5 Feb 2021 • Xi Chen, Zehua Lai, He Li, Yichen Zhang
We first present the asymptotic distribution for the Polyak-Ruppert-averaging type Kiefer-Wolfowitz (AKW) estimators, whose asymptotic covariance matrices depend on the distribution of search directions and the function-value query complexity.
no code implementations • 2 Jun 2020 • Zehua Lai, Lek-Heng Lim
Our approach relies on the noncommutative Positivstellensatz, which allows us to reduce the conjectured inequality to a semidefinite program and the validity of the conjecture to certain bounds for the optimum values, which we show are false as soon as $n = 5$.