1 code implementation • NIPS 2022 • Peng Jiang, Lihan Hu, Shihui Song
At higher sparsity, our algorithm can still match the accuracy of nonstructured sparse training in most cases, while reducing the training time by up to 5x due to the fine-grained block structures in the models.
