no code implementations • 6 Jul 2023 • Gene-Ping Yang, Yue Gu, Qingming Tang, Dongsu Du, Yuzong Liu
Our approach used a teacher-student framework to transfer knowledge from a larger, more complex model to a smaller, light-weight model using dual-view cross-correlation distillation and the teacher's codebook as learning objectives.
no code implementations • 21 Apr 2023 • Zuhaib Akhtar, Mohammad Omar Khursheed, Dongsu Du, Yuzong Liu
In this work, we present Slimmable Neural Networks applied to the problem of small-footprint keyword spotting.