Empirical evaluation of Uncertainty Quantification in Retrieval-Augmented Language Models for Science

1 code implementation • 15 Nov 2023 • Sridevi Wagle, Sai Munikoti, Anurag Acharya, Sara Smith, Sameera Horawalavithana

This research investigates how uncertainty scores vary when scientific knowledge is incorporated as pretraining and retrieval data and explores the relationship between uncertainty scores and the accuracy of model-generated outputs.

Retrieval Uncertainty Quantification

NuclearQA: A Human-Made Benchmark for Language Models for the Nuclear Domain

1 code implementation • 17 Oct 2023 • Anurag Acharya, Sai Munikoti, Aaron Hellinger, Sara Smith, Sridevi Wagle, Sameera Horawalavithana

As LLMs have become increasingly popular, they have been used in almost every field.