Compression-aware Continual Learning using Singular Value Decomposition

1 code implementation • 3 Sep 2020 • Varigonda Pavan Teja, Priyadarshini Panda

Specifically, we decompose the weight filters using SVD and train the network on incremental tasks in its factorized form.

Continual Learning Model Compression