no code implementations • 31 May 2017 • Dan Oprisa, Peter Toth
Guided by critical systems found in nature we develop a novel mechanism consisting of inhomogeneous polynomial regularisation via which we can induce scale invariance in deep learning systems.
no code implementations • 26 Feb 2017 • Dan Oprisa, Peter Toth
Motivated by the idea that criticality and universality of phase transitions might play a crucial role in achieving and sustaining learning and intelligent behaviour in biological and artificial networks, we analyse a theoretical and a pragmatic experimental set up for critical phenomena in deep learning.
