1 code implementation • 14 Dec 2023 • Guiqin Wang, Peng Zhao, Yanjiang Shi, Cong Zhao, Shusen Yang
Addressing this gap, our paper introduces an innovative knowledge distillation framework, with the generative model for training a lightweight student model.