no code implementations • 20 Jan 2024 • Suchana Datta, Debasis Ganguly, Sean MacAvaney, Derek Greene
Additionally, to further improve retrieval effectiveness with this selective PRF approach, we make use of the model's confidence estimates to combine the information from the original and expanded queries.
no code implementations • 1 Apr 2023 • Suchana Datta, Debasis Ganguly, Derek Greene, Mandar Mitra
Despite the retrieval effectiveness of queries being mutually independent of one another, the evaluation of query performance prediction (QPP) systems has been carried out by measuring rank correlation over an entire set of queries.
no code implementations • 15 Feb 2022 • Suchana Datta, Debasis Ganguly, Derek Greene, Mandar Mitra
In contrast to unsupervised approaches that rely on various statistics of document score distributions, our approach is entirely data-driven.
no code implementations • 13 Feb 2022 • Debasis Ganguly, Suchana Datta, Mandar Mitra, Derek Greene
An important characteristic of QPP evaluation is that, since the ground truth retrieval effectiveness for QPP evaluation can be measured with different metrics, the ground truth itself is not absolute, which is in contrast to other retrieval tasks, such as that of ad-hoc retrieval.