Adaptive Momentum Coefficient for Neural Network Optimization

1 code implementation • 4 Jun 2020 • Zana Rashidi, Kasra Ahmadi K. A., Aijun An, Xiaogang Wang

We propose a novel and efficient momentum-based first-order algorithm for optimizing neural networks which uses an adaptive coefficient for the momentum term.

Bandlimiting Neural Networks Against Adversarial Attacks

no code implementations • ICLR 2020 • Yuping Lin, Kasra Ahmadi K. A., Hui Jiang

We first explicitly compute the Fourier transform of deep ReLU neural networks and show that there exist decaying but non-zero high frequency components in the Fourier spectrum of neural networks.

Adversarial Attack