Multi Resolution Analysis (MRA) for Approximate Self-Attention

1 code implementation • 21 Jul 2022 • Zhanpeng Zeng, Sourav Pal, Jeffery Kline, Glenn M Fung, Vikas Singh

Transformers have emerged as a preferred model for many tasks in natural langugage processing and vision.