Implicit Regularization in Hierarchical Tensor Factorization and Deep Convolutional Neural Networks

1 code implementation • 27 Jan 2022 • Noam Razin, Asaf Maman, Nadav Cohen

In the pursuit of explaining implicit regularization in deep learning, prominent focus was given to matrix and tensor factorizations, which correspond to simplified neural networks.

Implicit Regularization in Tensor Factorization

1 code implementation • 19 Feb 2021 • Noam Razin, Asaf Maman, Nadav Cohen

Recent efforts to unravel the mystery of implicit regularization in deep learning have led to a theoretical focus on matrix factorization -- matrix completion via linear neural network.

Matrix Completion