1 code implementation • 3 Nov 2023 • Alex Wilf, Alex Tianyi Xu, Paul Pu Liang, Alexander Obolenskiy, Daniel Fried, Louis-Philippe Morency
We observe that prevalent KD techniques and state of the art data augmentation strategies fall short in this constrained setting.