no code implementations • 4 Feb 2024 • Yunyan Bai, Yuxing Liu, Luo Luo
This paper considers the optimization problem of the form $\min_{{\bf x}\in{\mathbb R}^d} f({\bf x})\triangleq \frac{1}{n}\sum_{i=1}^n f_i({\bf x})$, where $f(\cdot)$ satisfies the Polyak--{\L}ojasiewicz (PL) condition with parameter $\mu$ and $\{f_i(\cdot)\}_{i=1}^n$ is $L$-mean-squared smooth.
no code implementations • 22 Dec 2023 • Rui Pan, Yuxing Liu, Xiaoyu Wang, Tong Zhang
This means SGD with heavy-ball momentum is useful in the large-batch settings such as distributed machine learning or federated learning, where a smaller number of iterations can significantly reduce the number of communication rounds, leading to acceleration in practice.
no code implementations • 19 Oct 2021 • Dennis Kibalama, Yuxing Liu, Stephanie Stockar, Marcello Canova
Among the auxiliary loads in light-duty vehicles, the air conditioning system is the single largest energy consumer.