Decorrelated Batch Normalization (DBN) is a normalization technique which not just centers and scales activations but whitens them. ZCA whitening instead of PCA whitening is employed since PCA whitening causes a problem called stochastic axis swapping, which is detrimental to learning.
Source: Decorrelated Batch NormalizationPaper | Code | Results | Date | Stars |
---|