Search Results for author: Jennifer Hsia

Found 2 papers, 1 papers with code

RAGGED: Towards Informed Design of Retrieval Augmented Generation Systems

1 code implementation14 Mar 2024 Jennifer Hsia, Afreen Shaikh, Zhiruo Wang, Graham Neubig

RAGGED offers further insights into LMs' context utilization habits, where we find that encoder-decoder models rely more on contexts and are thus more sensitive to retrieval quality, while decoder-only models tend to rely on knowledge memorized during training.

Decoder Question Answering +1

Goodhart's Law Applies to NLP's Explanation Benchmarks

no code implementations28 Aug 2023 Jennifer Hsia, Danish Pruthi, Aarti Singh, Zachary C. Lipton

First, we show that we can inflate a model's comprehensiveness and sufficiency scores dramatically without altering its predictions or explanations on in-distribution test inputs.

Cannot find the paper you are looking for? You can Submit a new open access paper.