no code implementations • 22 May 2024 • Tobias Leemann, Alina Fastowski, Felix Pfeiffer, Gjergji Kasneci
We address the critical challenge of applying feature attribution methods to the transformer architecture, which dominates current applications in natural language processing and beyond.
1 code implementation • 1 Jun 2023 • Katharina Hämmerl, Alina Fastowski, Jindřich Libovický, Alexander Fraser
We investigate outlier dimensions and their relationship to anisotropy in multiple pre-trained multilingual language models.