Search Results for author: Swarnadeep Bhar

Found 3 papers, 1 papers with code

Strong hallucinations from negation and how to fix them

no code implementations16 Feb 2024 Nicholas Asher, Swarnadeep Bhar

Despite great performance on many tasks, language models (LMs) still struggle with reasoning, sometimes providing responses that cannot possibly be true because they stem from logical incoherence.

Natural Language Inference Negation

Limits for Learning with Language Models

no code implementations21 Jun 2023 Nicholas Asher, Swarnadeep Bhar, Akshay Chaturvedi, Julie Hunter, Soumya Paul

With the advent of large language models (LLMs), the trend in NLP has been to train LLMs on vast amounts of data to solve diverse language understanding and generation tasks.

Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering

1 code implementation21 Dec 2022 Akshay Chaturvedi, Swarnadeep Bhar, Soumadeep Saha, Utpal Garain, Nicholas Asher

While transformer models achieve high performance on standard question answering tasks, we show that they fail to be semantically faithful once we perform these interventions for a significant number of cases (~50% for deletion intervention, and ~20% drop in accuracy for negation intervention).

Conversational Question Answering Negation

Cannot find the paper you are looking for? You can Submit a new open access paper.