Search Results for author: Sullam Jeoung

Found 4 papers, 2 papers with code

Raison d’être of the benchmark dataset: A Survey of Current Practices of Benchmark Dataset Sharing Platforms

no code implementations nlppower (ACL) 2022 Jaihyun Park, Sullam Jeoung

We propose that the benchmark dataset should develop social impact metadata and data curator should take a role in managing the social impact metadata.

StereoMap: Quantifying the Awareness of Human-like Stereotypes in Large Language Models

1 code implementation20 Oct 2023 Sullam Jeoung, Yubin Ge, Jana Diesner

Based on the SCM theory, StereoMap maps LLMs' perceptions of social groups (defined by socio-demographic features) using the dimensions of Warmth and Competence.

Examining the Causal Effect of First Names on Language Models: The Case of Social Commonsense Reasoning

1 code implementation1 Jun 2023 Sullam Jeoung, Jana Diesner, Halil Kilicoglu

As language models continue to be integrated into applications of personal and societal relevance, ensuring these models' trustworthiness is crucial, particularly with respect to producing consistent outputs regardless of sensitive attributes.

What Changed? Investigating Debiasing Methods using Causal Mediation Analysis

no code implementations NAACL (GeBNLP) 2022 Sullam Jeoung, Jana Diesner

Previous work has examined how debiasing language models affect downstream tasks, specifically, how debiasing techniques influence task performance and whether debiased models also make impartial predictions in downstream tasks or not.

Cannot find the paper you are looking for? You can Submit a new open access paper.