Paying more attention to snapshots of Iterative Pruning: Improving Model Compression via Ensemble Distillation

1 code implementation • BMVC 2020 • Duong H. Le, Trung-Nhan Vo, Nam Thoai

In this work, we show that strong ensembles can be constructed from snapshots of iterative pruning, which achieve competitive performance and vary in network structure.

Image Classification Knowledge Distillation +2