Search Results for author: Sagnik Ray Choudhury

Found 14 papers, 8 papers with code

Machine Reading, Fast and Slow: When Do Models “Understand” Language?

no code implementations COLING 2022 Sagnik Ray Choudhury, Anna Rogers, Isabelle Augenstein

Two of the most fundamental issues in Natural Language Understanding (NLU) at present are: (a) how it can established whether deep learning-based models score highly on NLU benchmarks for the ”right” reasons; and (b) what those reasons would even be.

coreference-resolution counterfactual +2

Can Edge Probing Tests Reveal Linguistic Knowledge in QA Models?

no code implementations COLING 2022 Sagnik Ray Choudhury, Nikita Bhutani, Isabelle Augenstein

We find that EP test results do not change significantly when the fine-tuned model performs well or in adversarial situations where the model is forced to learn wrong correlations.

Question Answering

Explaining Interactions Between Text Spans

1 code implementation20 Oct 2023 Sagnik Ray Choudhury, Pepa Atanasova, Isabelle Augenstein

Reasoning over spans of tokens from different parts of the input is essential for natural language understanding (NLU) tasks such as fact-checking (FC), machine reading comprehension (MRC) or natural language inference (NLI).

Community Detection Decision Making +6

Implications of Annotation Artifacts in Edge Probing Test Datasets

1 code implementation20 Oct 2023 Sagnik Ray Choudhury, Jushaan Kalra

However, a large body of research claims that the tests necessarily do not measure the LLM's capacity to encode knowledge, but rather reflect the classifiers' ability to learn the problem.

Memorization

Machine Reading, Fast and Slow: When Do Models "Understand" Language?

no code implementations15 Sep 2022 Sagnik Ray Choudhury, Anna Rogers, Isabelle Augenstein

Two of the most fundamental challenges in Natural Language Understanding (NLU) at present are: (a) how to establish whether deep learning-based models score highly on NLU benchmarks for the 'right' reasons; and (b) to understand what those reasons would even be.

coreference-resolution counterfactual +2

Can Edge Probing Tasks Reveal Linguistic Knowledge in QA Models?

no code implementations15 Sep 2021 Sagnik Ray Choudhury, Nikita Bhutani, Isabelle Augenstein

We find that EP test results do not change significantly when the fine-tuned model performs well or in adversarial situations where the model is forced to learn wrong correlations.

Question Answering

Intent Features for Rich Natural Language Understanding

1 code implementation NAACL 2021 Brian Lester, Sagnik Ray Choudhury, Rashmi Prasad, Srinivas Bangalore

Complex natural language understanding modules in dialog systems have a richer understanding of user utterances, and thus are critical in providing a better user experience.

Natural Language Understanding

Multiple Word Embeddings for Increased Diversity of Representation

1 code implementation30 Sep 2020 Brian Lester, Daniel Pressel, Amy Hemmeter, Sagnik Ray Choudhury, Srinivas Bangalore

Most state-of-the-art models in natural language processing (NLP) are neural models built on top of large, pre-trained, contextual language models that generate representations of words in context and are fine-tuned for the task at hand.

Word Embeddings

Computationally Efficient NER Taggers with Combined Embeddings and Constrained Decoding

1 code implementation5 Jan 2020 Brian Lester, Daniel Pressel, Amy Hemmeter, Sagnik Ray Choudhury

The CRF layer is used to facilitate global coherence between labels, and the contextual embeddings provide a better representation of words in context.

named-entity-recognition Named Entity Recognition +2

Keyword and Keyphrase Extraction Using Centrality Measures on Collocation Networks

no code implementations25 Jan 2014 Shibamouli Lahiri, Sagnik Ray Choudhury, Cornelia Caragea

Keyword and keyphrase extraction is an important problem in natural language processing, with applications ranging from summarization to semantic search to document clustering.

Clustering Keyphrase Extraction

Cannot find the paper you are looking for? You can Submit a new open access paper.