1 code implementation • 14 Feb 2023 • Lars Buijtelaar, Sandro Pezzelle
We build on recent studies that explore semantic information in Transformers at the word level and test whether BERT aligns with human semantic intuitions when dealing with expressions (e. g., sunlight) whose overall meaning depends -- to a various extent -- on the semantics of the constituent words (sun, light).
