Search Results for author: Xianfeng Liang

Found 5 papers, 3 papers with code

SPAN: A Stochastic Projected Approximate Newton Method

no code implementations10 Feb 2020 Xunpeng Huang, Xianfeng Liang, Zhengyang Liu, Yitan Li, Linyun Yu, Yue Yu, Lei LI

SPAN computes the inverse of the Hessian matrix via low-rank approximation and stochastic Hessian-vector products.

Variance Reduced Local SGD with Lower Communication Complexity

1 code implementation30 Dec 2019 Xianfeng Liang, Shuheng Shen, Jingchang Liu, Zhen Pan, Enhong Chen, Yifei Cheng

To accelerate the training of machine learning models, distributed stochastic gradient descent (SGD) and its variants have been widely adopted, which apply multiple workers in parallel to speed up training.

BIG-bench Machine Learning

Long-term Joint Scheduling for Urban Traffic

1 code implementation27 Oct 2019 Xianfeng Liang, Likang Wu, Joya Chen, Yang Liu, Runlong Yu, Min Hou, Han Wu, Yuyang Ye, Qi Liu, Enhong Chen

Recently, the traffic congestion in modern cities has become a growing worry for the residents.

Scheduling

Faster Distributed Deep Net Training: Computation and Communication Decoupled Stochastic Gradient Descent

no code implementations28 Jun 2019 Shuheng Shen, Linli Xu, Jingchang Liu, Xianfeng Liang, Yifei Cheng

Nevertheless, although distributed stochastic gradient descent (SGD) algorithms can achieve a linear iteration speedup, they are limited significantly in practice by the communication cost, making it difficult to achieve a linear time speedup.

Cannot find the paper you are looking for? You can Submit a new open access paper.