1 code implementation • 27 Apr 2022 • Prashansa Gupta, Sean MacAvaney
We observe that this bias could be present in the popular MS MARCO dataset, given that annotators could not find answers to 38--45% of the queries, leading to these queries being discarded in training and evaluation processes.