Search Results for author: Zhihao Chi

Found 2 papers, 1 papers with code

NormKD: Normalized Logits for Knowledge Distillation

1 code implementation1 Aug 2023 Zhihao Chi, Tu Zheng, Hengjia Li, Zheng Yang, Boxi Wu, Binbin Lin, Deng Cai

In this paper, we restudy the hyper-parameter temperature and figure out its incapability to distill the knowledge from each sample sufficiently when it is a single value.

Image Classification Knowledge Distillation

Cannot find the paper you are looking for? You can Submit a new open access paper.