KD-DLGAN: Data Limited Image Generation via Knowledge Distillation

no code implementations • CVPR 2023 • Kaiwen Cui, Yingchen Yu, Fangneng Zhan, Shengcai Liao, Shijian Lu1, Eric Xing

The first is aggregated generative KD that mitigates the discriminator overfitting by challenging the discriminator with harder learning tasks and distilling more generalizable knowledge from the pre-trained models.

Image Generation Knowledge Distillation