1 code implementation • 24 Nov 2021 • Zhihang Yuan, Chenhao Xue, Yiqi Chen, Qiang Wu, Guangyu Sun
We observe the distributions of activation values after softmax and GELU functions are quite different from the Gaussian distribution.
no code implementations • 15 Oct 2021 • Zhihang Yuan, Yiqi Chen, Chenhao Xue, Chenguang Zhang, Qiankun Wang, Guangyu Sun
Network quantization is a powerful technique to compress convolutional neural networks.