Search Results for author: David Arps

Found 5 papers, 3 papers with code

HHUplexity at Text Complexity DE Challenge 2022

no code implementations GermEval 2022 David Arps, Jan Kels, Florian Krämer, Yunus Renz, Regina Stodden, Wiebke Petersen

In this paper, we describe our submission to the ‘Text Complexity DE Challenge 2022’ shared task on predicting the complexity of German sentences.

regression

Multilingual Nonce Dependency Treebanks: Understanding how LLMs represent and process syntactic structure

no code implementations13 Nov 2023 David Arps, Laura Kallmeyer, Younes Samih, Hassan Sajjad

We replicate the findings of M\"uller-Eberstein et al. (2022) on nonce test data and show that the performance declines on both MLMs and ALMs wrt.

Increasing The Performance of Cognitively Inspired Data-Efficient Language Models via Implicit Structure Building

1 code implementation31 Oct 2023 Omar Momen, David Arps, Laura Kallmeyer

In this paper, we describe our submission to the BabyLM Challenge 2023 shared task on data-efficient language model (LM) pretraining (Warstadt et al., 2023).

Language Modelling Sentence

Probing for Constituency Structure in Neural Language Models

1 code implementation13 Apr 2022 David Arps, Younes Samih, Laura Kallmeyer, Hassan Sajjad

We find that 4 pretrained transfomer LMs obtain high performance on our probing tasks even on manipulated data, suggesting that semantic and syntactic knowledge in their representations can be separated and that constituency information is in fact learned by the LM.

Cannot find the paper you are looking for? You can Submit a new open access paper.