no code implementations • 9 Jun 2023 • Yang Tian, Zeren Tan, Hedong Hou, Guoqi Li, Aohua Cheng, Yike Qiu, Kangyu Weng, Chun Chen, Pei Sun
These problems stem from the non-triviality and immaturity of the physical theories that analytically derive brain criticality and the statistic techniques that estimate brain criticality from empirical data.
no code implementations • 4 Dec 2022 • Kangyu Weng, Aohua Cheng, Ziyang Zhang, Pei Sun, Yang Tian
Finally, we analyze our findings with information bottleneck theory to confirm the precise relations among dynamic isometry, mutual information maximization, and optimal channel properties in deep learning.
