Conformal Prediction with Large Language Models for Multi-Choice Question Answering

1 code implementation • 28 May 2023 • Bhawesh Kumar, Charlie Lu, Gauri Gupta, Anil Palepu, David Bellamy, Ramesh Raskar, Andrew Beam

In this work, we explore how conformal prediction can be used to provide uncertainty quantification in language models for the specific task of multiple-choice question-answering.

Conformal Prediction Multiple-choice +2