Parameter Norm Penalties
General • Regularization • 3 methods
Parameter Norm Penalties are regularization methods that apply a penalty to the norm of parameters in the objective function of a neural network. Below you can find a continuously updating list of parameter norm penalties.
Methods
| Method | Year | Papers |
|---|---|---|
| 1943 | 7700 | |
| 1986 | 70 | |
| 2022 | 17 |
Weight Decay
L1 Regularization
ROME
