Search Results for author:
Found 2 papers, 0 papers with code
Spectral Batch Normalization: Normalization in the Frequency Domain
However, we show experimentally that, despite the approximate additive penalty of BN, feature maps in deep neural networks (DNNs) tend to explode at the beginning of the network and that feature maps of DNNs contain large values during the whole training.
Weight Compander: A Simple Weight Reparameterization for Regularization
Large weights in deep neural networks are a sign of a more complex network that is overfitted to the training data.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
