no code implementations • nlppower (ACL) 2022 • Jaihyun Park, Sullam Jeoung
We propose that the benchmark dataset should develop social impact metadata and data curator should take a role in managing the social impact metadata.
1 code implementation • 20 Oct 2023 • Sullam Jeoung, Yubin Ge, Jana Diesner
Based on the SCM theory, StereoMap maps LLMs' perceptions of social groups (defined by socio-demographic features) using the dimensions of Warmth and Competence.
1 code implementation • 1 Jun 2023 • Sullam Jeoung, Jana Diesner, Halil Kilicoglu
As language models continue to be integrated into applications of personal and societal relevance, ensuring these models' trustworthiness is crucial, particularly with respect to producing consistent outputs regardless of sensitive attributes.
no code implementations • NAACL (GeBNLP) 2022 • Sullam Jeoung, Jana Diesner
Previous work has examined how debiasing language models affect downstream tasks, specifically, how debiasing techniques influence task performance and whether debiased models also make impartial predictions in downstream tasks or not.