Regularization

Stable Rank Normalization

Introduced by Sanyal et al. in Stable Rank Normalization for Improved Generalization in Neural Networks and GANs

Stable Rank Normalization (SRN) is a weight-normalization scheme which minimizes the stable rank of a linear operator. It simultaneously controls the Lipschitz constant and the stable rank of a linear operator. Stable rank is a softer version of the rank operator and is defined as the squared ratio of the Frobenius norm to the spectral norm.

Source: Stable Rank Normalization for Improved Generalization in Neural Networks and GANs

Papers


Paper Code Results Date Stars

Components


Component Type
🤖 No Components Found You can add them if they exist; e.g. Mask R-CNN uses RoIAlign

Categories