1 code implementation • 31 Oct 2022 • Bo Zhao, Iordan Ganev, Robin Walters, Rose Yu, Nima Dehmamy
Empirical studies of the loss landscape of deep networks have revealed that many local minima are connected through low-loss valleys.
no code implementations • 26 Jul 2022 • Iordan Ganev, Robin Walters
We develop a uniform theoretical approach towards the analysis of various neural network connectivity architectures by introducing the notion of a quiver neural network.
no code implementations • 29 Sep 2021 • Iordan Ganev, Robin Walters
We provide a theoretical framework for neural networks in terms of the representation theory of quivers, thus revealing symmetries of the parameter space of neural networks.
1 code implementation • 6 Jul 2021 • Iordan Ganev, Twan van Laarhoven, Robin Walters
We introduce a class of fully-connected neural networks whose activation functions, rather than being pointwise, rescale feature vectors by a function depending only on their norm.