Activate or Not: Learning Customized Activation

Modern activation layers use non-linear functions to activate the neurons. In this paper, we present a simple but effective activation function we term ACON which learns to activate the neurons or not... (read more)

Results in Papers With Code
(↓ scroll down to see all results)