Search Results for author:
Found 2 papers, 1 papers with code
Distilling the Undistillable: Learning from a Nasty Teacher
The inadvertent stealing of private/sensitive information using Knowledge Distillation (KD) has been getting significant attention recently and has guided subsequent defense efforts considering its critical nature.
A Deeper Look at the Hessian Eigenspectrum of Deep Neural Networks and its Applications to Regularization
In this work, we propose a layerwise loss landscape analysis where the loss surface at every layer is studied independently and also on how each correlates to the overall loss surface.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
