1 code implementation • 25 Oct 2023 • Peixuan Han, Zhenghao Liu, Zhiyuan Liu, Chenyan Xiong
In this paper, we introduce WebDRO, an efficient approach for clustering the web graph data and optimizing group weights to enhance the robustness of the pretraining process of dense retrieval models on web graphs.