Accelerating Vision Transformer Training via a Patch Sampling Schedule

1 code implementation • 19 Aug 2022 • Bradley McDanel, Chi Phuong Huynh

For the pre-trained model, we achieve a 0. 26% reduction in classification accuracy for a 31% reduction in training time (from 25 to 17 hours) compared to using all patches each iteration.