Characterizing emergent representations in a space of candidate learning rules for deep networks

no code implementations • NeurIPS 2020 • Yinan Cao, Christopher Summerfield, Andrew Saxe

Studies suggesting that representations in deep networks resemble those in biological brains have mostly relied on one specific learning rule: gradient descent, the workhorse behind modern deep learning.