# SMYRF: Efficient Attention using Asymmetric Clustering

We propose a novel type of balanced clustering algorithm to approximate attention. Attention complexity is reduced from $O(N^2)$ to $O(N \log N)$, where $N$ is the sequence length... (read more)

PDF Abstract

# Code Add Remove Mark official

 ↳ Quickstart in
32