no code implementations • GermEval 2022 • David Arps, Jan Kels, Florian Krämer, Yunus Renz, Regina Stodden, Wiebke Petersen
In this paper, we describe our submission to the ‘Text Complexity DE Challenge 2022’ shared task on predicting the complexity of German sentences.
no code implementations • 13 Nov 2023 • David Arps, Laura Kallmeyer, Younes Samih, Hassan Sajjad
We replicate the findings of M\"uller-Eberstein et al. (2022) on nonce test data and show that the performance declines on both MLMs and ALMs wrt.
1 code implementation • 31 Oct 2023 • Omar Momen, David Arps, Laura Kallmeyer
In this paper, we describe our submission to the BabyLM Challenge 2023 shared task on data-efficient language model (LM) pretraining (Warstadt et al., 2023).
1 code implementation • 13 Apr 2022 • David Arps, Younes Samih, Laura Kallmeyer, Hassan Sajjad
We find that 4 pretrained transfomer LMs obtain high performance on our probing tasks even on manipulated data, suggesting that semantic and syntactic knowledge in their representations can be separated and that constituency information is in fact learned by the LM.