Attend, Distill, Detect: Attention-aware Entropy Distillation for Anomaly Detection

no code implementations • 10 May 2024 • Sushovan Jena, Vishwas Saini, Ujjwal Shaw, Pavitra Jain, Abhay Singh Raihal, Anoushka Banerjee, Sharad Joshi, Ananth Ganesh, Arnav Bhavsar

Briefly, our DCAM module consists of Convolutional Attention blocks distributed across the feature maps of the student network, which essentially learns to masks the irrelevant information during student learning alleviating the "cross-class interference" problem.

Knowledge Distillation Unsupervised Anomaly Detection