no code implementations • 20 Aug 2023 • Yiming Huang, Aozhe Jia, Xiaodan Zhang, Jiawei Zhang
In this paper, we propose a weighted relevancy strategy, which takes the importance of token values into consideration, to reduce distortion when equally accumulating relevance.