Mitigating Communication Costs in Neural Networks: The Role of Dendritic Nonlinearity

no code implementations • 21 Jun 2023 • Xundong Wu, Pengfei Zhao, Zilin Yu, Lei Ma, Ka-Wa Yip, Huajin Tang, Gang Pan, Tiejun Huang

Our comprehension of biological neuronal networks has profoundly influenced the evolution of artificial neural networks (ANNs).

Intragroup sparsity for efficient inference

no code implementations • 1 Jan 2021 • Zilin Yu, Chao Wang, Xin Wang, Yong Zhao, Xundong Wu

This work studies intragroup sparsity, a fine-grained structural constraint on network weight parameters.

PP-OCR: A Practical Ultra Lightweight OCR System

9 code implementations • 21 Sep 2020 • Yuning Du, Chenxia Li, Ruoyu Guo, Xiaoting Yin, Weiwei Liu, Jun Zhou, Yifan Bai, Zilin Yu, Yehua Yang, Qingqing Dang, Haoshuang Wang

Meanwhile, several pre-trained models for the Chinese and English recognition are released, including a text detector (97K images are used), a direction classifier (600K images are used) as well as a text recognizer (17. 9M images are used).

Computational Efficiency Optical Character Recognition +1