no code implementations • 22 Jul 2023 • Weiyang Wang, Manya Ghobadi, Kayvon Shakeri, Ying Zhang, Naader Hasani
We show that LLMs exhibit a unique communication pattern where only small groups of GPUs require high-bandwidth communication to achieve near-optimal training performance.
no code implementations • 7 Feb 2022 • Liangyu Zhao, Siddharth Pal, Tapan Chugh, Weiyang Wang, Jason Fantl, Prithwish Basu, Joud Khoury, Arvind Krishnamurthy
Our algorithms start from small, optimal base topologies and associated communication schedules and use a set of techniques that can be iteratively applied to derive much larger topologies and schedules.
1 code implementation • 10 Mar 2020 • Rui Luo, Yunpeng Men, Kejia Lee, Weiyang Wang, D. R. Lorimer, Bing Zhang
Assuming a Schechter luminosity function form, we infer (at the 95% confidence level) that the characteristic FRB event rate density at the upper cut-off luminosity $L^*=2. 9_{-1. 7}^{+11. 9}\times10^{44}\,\rm erg\, s^{-1}$ is $\phi^*=339_{-313}^{+1074}\,\rm Gpc^{-3}\, yr^{-1}$, the power-law index is $\alpha=-1. 79_{-0. 35}^{+0. 31}$, and the lower cut-off luminosity is $L_0\le9. 1\times10^{41}\,\rm erg\, s^{-1}$.
High Energy Astrophysical Phenomena Cosmology and Nongalactic Astrophysics
no code implementations • 18 Nov 2019 • Zehua Cheng, Weiyang Wang, Yan Pan, Thomas Lukasiewicz
However, most low precision training solution is based on a mixed precision strategy.
no code implementations • 30 Apr 2019 • Zehua Cheng, Yuxiang Wu, Zhenghua Xu, Thomas Lukasiewicz, Weiyang Wang
Region proposal mechanisms are essential for existing deep learning approaches to object detection in images.
Ranked #1 on Head Detection on Rebar Head
no code implementations • 22 Apr 2019 • Yuxiang Wu, Zehua Cheng, Bin Huang, Yiming Chen, Xinghui Zhu, Weiyang Wang
Multi-face alignment aims to identify geometry structures of multiple faces in an image, and its performance is essential for the many practical tasks, such as face recognition, face tracking, and face animation.
no code implementations • 6 Jul 2017 • Xiangru Kong, Linyang Li, Ortwin Leenaerts, Weiyang Wang, Xiong-Jun Liu, François M. Peeters
The quantum anomalous Hall (QAH) effect is a topologically nontrivial phase, characterized by a non-zero Chern number defined in the bulk and chiral edge states in the boundary.
Materials Science