no code implementations • 25 May 2024 • Si Xu, Zixiao Huang, Yan Zeng, Shengen Yan, Xuefei Ning, Haolin Ye, Sipei Gu, Chunsheng Shui, Zhezheng Lin, Hao Zhang, Sheng Wang, Guohao Dai, Yu Wang
To address the problem, this paper proposes a distributed training system with hybrid parallelism support on heterogeneous GPU-accelerators for large-scale models.
no code implementations • 6 Apr 2024 • Chuqin Geng, Zhaoyue Wang, Haolin Ye, Saifei Liao, Xujie Si
In this paper, we study the following problem: Given a neural network, find a minimal (coarsest) NAP that is sufficient for formal verification of the network's robustness.
no code implementations • 15 Nov 2022 • Chuqin Geng, Xiaojie Xu, Haolin Ye, Xujie Si
However, we argue that biases can be disregarded for some image-related tasks such as image classification, by considering the intrinsic distribution of images in the input space and desired model properties from first principles.
no code implementations • 7 Oct 2022 • Chuqin Geng, Haolin Ye, Yixuan Li, Tianyu Han, Brigitte Pientka, Xujie Si
Strong static type systems help programmers eliminate many errors without much burden of supplying type annotations.