no code implementations • ICLR 2022 • Yen-Chang Hsu, Ting Hua, SungEn Chang, Qian Lou, Yilin Shen, Hongxia Jin
In other words, the optimization objective of SVD is not aligned with the trained model's task accuracy.
Language Modelling Model Compression