Pre-training with Aspect-Content Text Mutual Prediction for Multi-Aspect Dense Retrieval

1 code implementation • 22 Aug 2023 • Xiaojie Sun, Keping Bi, Jiafeng Guo, Xinyu Ma, Fan Yixing, Hongyu Shan, Qishen Zhang, Zhongyi Liu

Extensive experiments on two real-world datasets (product and mini-program search) show that our approach can outperform competitive baselines both treating aspect values as classes and conducting the same MLM for aspect and content strings.

Language Modelling Masked Language Modeling +1