no code implementations • 8 Dec 2023 • Talfan Evans, Shreya Pathak, Hamza Merzic, Jonathan Schwarz, Ryutaro Tanno, Olivier J. Henaff
Power-law scaling indicates that large-scale training with uniform sampling is prohibitively slow.
no code implementations • ICCV 2021 • Yonglong Tian, Olivier J. Henaff, Aaron van den Oord
Self-supervised learning holds promise in leveraging large amounts of unlabeled data, however much of its progress has thus far been limited to highly curated pre-training data such as ImageNet.