no code implementations • 25 Feb 2024 • Zheng-an Chen, Tao Luo
Empirical and theoretical works show that the input weights of two-layer neural networks, when initialized with small values, converge towards isolated orientations.
