Search Results for author:
Found 3 papers, 0 papers with code
Fixing the Teacher-Student Knowledge Discrepancy in Distillation
To solve this problem, in this paper, we propose a novel student-dependent distillation method, knowledge consistent distillation, which makes teacher's knowledge more consistent with the student and provides the best suitable knowledge to different student networks for distillation.
Once a MAN: Towards Multi-Target Attack via Learning Multi-Target Adversarial Network Once
Recently, generation-based methods have received much attention since they directly use feed-forward networks to generate the adversarial samples, which avoid the time-consuming iterative attacking procedure in optimization-based and gradient-based methods.
Deep Self-Learning From Noisy Labels
Unlike previous works constrained by many conditions, making them infeasible to real noisy cases, this work presents a novel deep self-learning framework to train a robust network on the real noisy datasets without extra supervision.
