Mixture of Self-Supervised Learning

1 code implementation • 27 Jul 2023 • Aristo Renaldo Ruslim, Novanto Yudistira, Budi Darma Setiawan

Therefore, we propose the Gated Self-Supervised Learning method to improve image classification which use more than one transformation as pretext task and uses the Mixture of Expert architecture as a gating network in combining each pretext task so that the model automatically can study and focus more on the most useful augmentations for classification.

Classification Image Classification +1