Search Results for author: Soniya Vijayakumar

Found 3 papers, 0 papers with code

Where exactly does contextualization in a PLM happen?

no code implementations11 Dec 2023 Soniya Vijayakumar, Tanja Bäumel, Simon Ostermann, Josef van Genabith

Pre-trained Language Models (PLMs) have shown to be consistently successful in a plethora of NLP tasks due to their ability to learn contextualized representations of words (Ethayarajh, 2019).

Language Modelling Sentence +1

Interpretability in Activation Space Analysis of Transformers: A Focused Survey

no code implementations22 Jan 2023 Soniya Vijayakumar

The field of natural language processing has reached breakthroughs with the advent of transformers.

Cannot find the paper you are looking for? You can Submit a new open access paper.