1 code implementation • 5 Jun 2021 • Mengying Sun, Jing Xing, Huijun Wang, Bin Chen, Jiayu Zhou
Second, the contrastive scheme only learns representations that are invariant to local perturbations and thus does not consider the global structure of the dataset, which may also be useful for downstream tasks.
no code implementations • 26 Dec 2020 • Mengying Sun, Jing Xing, Bin Chen, Jiayu Zhou
In this paper, we study the underlying mechanism of how disagreement and agreement between networks can help reduce the noise in gradients and develop a novel framework called Robust Collaborative Learning (RCL) that leverages both disagreement and agreement among networks.