Beyond Self-Attention: Deformable Large Kernel Attention for Medical Image Segmentation

1 code implementation • 31 Aug 2023 • Reza Azad, Leon Niggemeier, Michael Huttemann, Amirhossein Kazerouni, Ehsan Khodapanah Aghdam, Yury Velichko, Ulas Bagci, Dorit Merhof

To address these challenges, we introduce the concept of \textbf{Deformable Large Kernel Attention (D-LKA Attention)}, a streamlined attention mechanism employing large convolution kernels to fully appreciate volumetric context.

Image Segmentation Medical Image Segmentation +1