1 code implementation • 26 Jun 2020 • Rajat Saini, Nandan Kumar Jha, Bedanta Das, Sparsh Mittal, C. Krishna Mohan
Our method of subspace attention is orthogonal and complementary to the existing state-of-the-arts attention mechanisms used in vision models.