Search Results for author: Venkata S Govindarajan

Found 6 papers, 4 papers with code

Counterfactually Probing Language Identity in Multilingual Models

1 code implementation29 Oct 2023 Anirudh Srinivasan, Venkata S Govindarajan, Kyle Mahowald

We use one such technique, AlterRep, a method of counterfactual probing, to explore the internal structure of multilingual models (mBERT and XLM-R).

counterfactual Masked Language Modeling +1

Lil-Bevo: Explorations of Strategies for Training Language Models in More Humanlike Ways

1 code implementation26 Oct 2023 Venkata S Govindarajan, Juan Diego Rodriguez, Kaj Bostrom, Kyle Mahowald

We pretrained our masked language models with three ingredients: an initial pretraining with music data, training on shorter sequences before training on longer ones, and masking specific tokens to target some of the BLiMP subtasks.

Language Modelling Masked Language Modeling

Counterfactual Probing for the Influence of Affect and Specificity on Intergroup Bias

1 code implementation25 May 2023 Venkata S Govindarajan, Kyle Mahowald, David I. Beaver, Junyi Jessy Li

While existing work on studying bias in NLP focues on negative or pejorative language use, Govindarajan et al. (2023) offer a revised framing of bias in terms of intergroup social context, and its effects on language behavior.

counterfactual Specificity

How people talk about each other: Modeling Generalized Intergroup Bias and Emotion

2 code implementations14 Sep 2022 Venkata S Govindarajan, Katherine Atwell, Barea Sinno, Malihe Alikhani, David I. Beaver, Junyi Jessy Li

Current studies of bias in NLP rely mainly on identifying (unwanted or negative) bias towards a specific demographic group.

Cannot find the paper you are looking for? You can Submit a new open access paper.