Sparse then Prune: Toward Efficient Vision Transformers

1 code implementation • 22 Jul 2023 • Yogi Prasetyo, Novanto Yudistira, Agus Wahyu Widodo

In this research, we investigate the possibility of applying Sparse Regularization to Vision Transformers and the impact of Pruning, either after Sparse Regularization or without it, on the trade-off between performance and efficiency.

Image Classification