Output Functions

Output functions are layers used towards the end of a network to transform to the desired form for a loss function. For example, the softmax relies on logits to construct a conditional probability. Below you can find a continuously updating list of output functions.

METHOD YEAR PAPERS
Softmax
2000 4720
Mixture of Logistic Distributions
2000 98
Adaptive Softmax
2016 26
Sparsemax
2016 12
Hierarchical Softmax
2000 6
Mixture of Softmaxes
2017 3