no code implementations • 4 Mar 2024 • Xiang Gao, Jiaxin Zhang, Lalla Mouatadid, Kamalika Das
Motivated by this gap, we introduce a novel UQ method, sampling with perturbation for UQ (SPUQ), designed to tackle both aleatoric and epistemic uncertainties.
no code implementations • 20 Feb 2024 • Jiaxin Zhang, Kamalika Das, Sricharan Kumar
Uncertainty estimation is a crucial aspect of deploying dependable deep learning models in safety-critical systems.
no code implementations • 17 Feb 2024 • Wendi Cui, Jiaxin Zhang, Zhuohang Li, Hao Sun, Damien Lopez, Kamalika Das, Bradley Malin, Sricharan Kumar
Crafting an ideal prompt for Large Language Models (LLMs) is a challenging task that demands significant resources and expert human input.
no code implementations • 30 Jan 2024 • Xiang Gao, Kamalika Das
However, it can be challenging to align LLMs with our intent, particularly when we want to generate content that is preferable over others or when we want the LLM to respond in a certain style or tone that is hard to describe.
1 code implementation • 4 Jan 2024 • Wendi Cui, Jiaxin Zhang, Zhuohang Li, Lopez Damien, Kamalika Das, Bradley Malin, Sricharan Kumar
Evaluating the quality and variability of text generated by Large Language Models (LLMs) poses a significant, yet unresolved research challenge.
no code implementations • 16 Nov 2023 • Jiaxin Zhang, Joy Rimchala, Lalla Mouatadid, Kamalika Das, Sricharan Kumar
The performance of optical character recognition (OCR) heavily relies on document image quality, which is crucial for automatic document processing and document intelligence.
1 code implementation • 3 Nov 2023 • Jiaxin Zhang, Zhuohang Li, Kamalika Das, Bradley A. Malin, Sricharan Kumar
Hallucination detection is a critical step toward understanding the trustworthiness of modern language models (LMs).
1 code implementation • 1 Aug 2022 • Frej Berglind, Haron Temam, Supratik Mukhopadhyay, Kamalika Das, Md Saiful Islam Sajol, Sricharan Kumar, Kumar Kallurupalli
Detecting out-of-distribution (OOD) data at inference time is crucial for many applications of machine learning.
Out-of-Distribution Detection Out of Distribution (OOD) Detection