Self-attention networks (SAN) have been introduced into automatic speech recognition (ASR) and achieved state-of-the-art performance owing to its superior ability in capturing long term dependency. One of the key ingredients is the self-attention mechanism which can be effectively performed on the whole utterance level... (read more)
PDFMETHOD | TYPE | |
---|---|---|
![]() |
Working Memory Models |