Search Results for author: Makesh Sreedhar

Found 3 papers, 2 papers with code

The Cost of Compression: Investigating the Impact of Compression on Parametric Knowledge in Language Models

1 code implementation1 Dec 2023 Satya Sai Srinath Namburi, Makesh Sreedhar, Srinath Srinivasan, Frederic Sala

Two standard compression techniques are pruning and quantization, with the former eliminating redundant connections in model layers and the latter representing model parameters with fewer bits.

Decoder Quantization

Single Sequence Prediction over Reasoning Graphs for Multi-hop QA

no code implementations1 Jul 2023 Gowtham Ramesh, Makesh Sreedhar, Junjie Hu

Recent generative approaches for multi-hop question answering (QA) utilize the fusion-in-decoder method~\cite{izacard-grave-2021-leveraging} to generate a single sequence output which includes both a final answer and a reasoning path taken to arrive at that answer, such as passage titles and key facts from those passages.

Decoder Multi-hop Question Answering +1

Cannot find the paper you are looking for? You can Submit a new open access paper.