Search Results for author: Vagrant Gautam

Found 5 papers, 2 papers with code

Robust Pronoun Use Fidelity with English LLMs: Are they Reasoning, Repeating, or Just Biased?

1 code implementation4 Apr 2024 Vagrant Gautam, Eileen Bingert, Dawei Zhu, Anne Lauscher, Dietrich Klakow

We find that while models can mostly faithfully reuse previously-specified pronouns in the presence of no distractors, they are significantly worse at processing she/her/her, singular they and neopronouns.

Sentence

What explains the success of cross-modal fine-tuning with ORCA?

no code implementations20 Mar 2024 Paloma García-de-Herreros, Vagrant Gautam, Philipp Slusallek, Dietrich Klakow, Marius Mosbach

ORCA (Shen et al., 2023) is a recent technique for cross-modal fine-tuning, i. e., applying pre-trained transformer models to modalities beyond their training data.

The Impact of Demonstrations on Multilingual In-Context Learning: A Multidimensional Analysis

no code implementations20 Feb 2024 Miaoran Zhang, Vagrant Gautam, Mingyang Wang, Jesujoba O. Alabi, Xiaoyu Shen, Dietrich Klakow, Marius Mosbach

Compared to work on monolingual (English) in-context learning, multilingual in-context learning is under-explored, and we lack an in-depth understanding of the role of demonstrations in this context.

GPT-3.5 GPT-4 +2

A Lightweight Method to Generate Unanswerable Questions in English

1 code implementation30 Oct 2023 Vagrant Gautam, Miaoran Zhang, Dietrich Klakow

If a question cannot be answered with the available information, robust systems for question answering (QA) should know _not_ to answer.

Data Augmentation Question Answering +2

Factoring the Matrix of Domination: A Critical Review and Reimagination of Intersectionality in AI Fairness

no code implementations16 Mar 2023 Anaelia Ovalle, Arjun Subramonian, Vagrant Gautam, Gilbert Gee, Kai-Wei Chang

Through a critical review of how intersectionality is discussed in 30 papers from the AI fairness literature, we deductively and inductively: 1) map how intersectionality tenets operate within the AI fairness paradigm and 2) uncover gaps between the conceptualization and operationalization of intersectionality.

Fairness

Cannot find the paper you are looking for? You can Submit a new open access paper.