no code implementations • 27 Feb 2024 • Hankyul Kang, Ming-Hsuan Yang, Jongbin Ryu
In this work, we propose an effective method to decompose the attention operation into query- and key-less components.