Synthesized Attention Mechanisms
 
Edit

Natural Language Processing • Attention Mechanisms • 4 methods

Methods
Add a Method

Method Year Papers
Dense Synthesized Attention
Synthesizer: Rethinking Self-Attention in Transformer Models
2020 1
Random Synthesized Attention
Synthesizer: Rethinking Self-Attention in Transformer Models
2020 1
Factorized Random Synthesized Attention
Synthesizer: Rethinking Self-Attention in Transformer Models
2020 1
Factorized Dense Synthesized Attention
Synthesizer: Rethinking Self-Attention in Transformer Models
2020 1
Contact us on: hello@paperswithcode.com . Papers With Code is a free resource with all data licensed under CC-BY-SA.
Terms Data policy Cookies policy