no code implementations • 28 Feb 2024 • Ercong Nie, Shuzhou Yuan, Bolei Ma, Helmut Schmid, Michael Färber, Frauke Kreuter, Hinrich Schütze
Despite the predominance of English in their training data, English-centric Large Language Models (LLMs) like GPT-3 and LLaMA display a remarkable ability to perform multilingual tasks, raising questions about the depth and nature of their cross-lingual capabilities.
1 code implementation • 22 Feb 2024 • Xinpeng Wang, Bolei Ma, Chengzhi Hu, Leon Weber-Genzel, Paul Röttger, Frauke Kreuter, Dirk Hovy, Barbara Plank
The open-ended nature of language generation makes the evaluation of autoregressive large language models (LLMs) challenging.
1 code implementation • 29 Jan 2024 • Bolei Ma, Ercong Nie, Shuzhou Yuan, Helmut Schmid, Michael Färber, Frauke Kreuter, Hinrich Schütze
However, most previous studies primarily focused on sentence-level classification tasks, and only a few considered token-level labeling tasks such as Named Entity Recognition (NER) and Part-of-Speech (POS) tagging.
1 code implementation • 23 Nov 2023 • Christoph Kern, Stephanie Eckman, Jacob Beck, Rob Chew, Bolei Ma, Frauke Kreuter
We introduce the term annotation sensitivity to refer to the impact of annotation data collection methods on the annotations themselves and on downstream model performance and predictions.
no code implementations • 29 Oct 2023 • Unai Fischer-Abaigar, Christoph Kern, Noam Barda, Frauke Kreuter
Machine Learning (ML) systems are becoming instrumental in the public sector, with applications spanning areas like criminal justice, social welfare, financial fraud detection, and public health.
no code implementations • 13 Jul 2023 • Christopher Weiss, Frauke Kreuter, Ivan Habernal
Although the NLP community has adopted central differential privacy as a go-to framework for privacy-preserving model training or data sharing, the choice and interpretation of the key parameter, privacy budget $\varepsilon$ that governs the strength of privacy protection, remains largely arbitrary.
no code implementations • 26 May 2023 • Cornelia Gruber, Patrick Oliver Schenk, Malte Schierholz, Frauke Kreuter, Göran Kauermann
Machine Learning and Deep Learning have achieved an impressive standard today, enabling us to answer questions that were inconceivable a few years ago.
no code implementations • 9 Mar 2023 • Anna-Carolina Haensch, Sarah Ball, Markus Herklotz, Frauke Kreuter
To address this gap, we analyzed the content on ChatGPT available on TikTok in February 2023.
no code implementations • 26 May 2022 • Amanda Fernández-Fontelo, Felix Henninger, Pascal J. Kieslich, Frauke Kreuter, Sonja Greven
We propose new ensemble models for multivariate functional data classification as combinations of semi-metric-based weak learners.
no code implementations • 4 Aug 2021 • Christoph Kern, Ruben L. Bach, Hannah Mautner, Frauke Kreuter
One example is the prediction-based statistical profiling of job seekers to guide the allocation of support measures by public employment services.
no code implementations • 4 May 2021 • Matthias Kuppler, Christoph Kern, Ruben L. Bach, Frauke Kreuter
The advent of powerful prediction algorithms led to increased automation of high-stake decisions regarding the allocation of scarce resources such as government spending and welfare support.
no code implementations • 21 Dec 2020 • Elena Badillo-Goicoechea, Ting-Hsuan Chang, Esther Kim, Sarah LaRocca, Katherine Morris, Xiaoyi Deng, Samantha Chiu, Adrianne Bradford, Andres Garcia, Christoph Kern, Curtiss Cobb, Frauke Kreuter, Elizabeth A. Stuart
Methods: We examined a total of 13, 723, 810 responses to a daily cross-sectional representative online survey in 38 countries who completed from April 23, 2020 to October 31, 2020 and reported having been in public at least once during the last seven days.
Applications
no code implementations • 5 Nov 2020 • Amanda Fernández-Fontelo, Pascal J. Kieslich, Felix Henninger, Frauke Kreuter, Sonja Greven
We use data from a survey on respondents' employment history and demographic information, in which we experimentally manipulate the difficulty of several questions.