Group Collaborative Learning for Co-Salient Object Detection

We present a novel group collaborative learning framework (GCoNet) capable of detecting co-salient objects in real time (16ms), by simultaneously mining consensus representations at group level based on the two necessary criteria: 1) intra-group compactness to better formulate the consistency among co-salient objects by capturing their inherent shared attributes using our novel group affinity module; 2) inter-group separability to effectively suppress the influence of noisy objects on the output by introducing our new group collaborating module conditioning the inconsistent consensus. To learn a better embedding space without extra computational overhead, we explicitly employ auxiliary classification supervision. Extensive experiments on three challenging benchmarks, i.e., CoCA, CoSOD3k, and Cosal2015, demonstrate that our simple GCoNet outperforms 10 cutting-edge models and achieves the new state-of-the-art. We demonstrate this paper's new technical contributions on a number of important downstream computer vision applications including content aware co-segmentation, co-localization based automatic thumbnails, etc.

PDF Abstract CVPR 2021 PDF CVPR 2021 Abstract

Datasets


Results from Other Papers


Task Dataset Model Metric Name Metric Value Rank Source Paper Compare
Co-Salient Object Detection CoCA GCoNet S-measure 0.673 # 6
max F-measure 0.544 # 6
mean E-measure 0.739 # 5
Mean F-measure 0.531 # 5
max E-measure 0.760 # 5
MAE 0.105 # 4
Co-Salient Object Detection CoSal2015 GCoNet MAE 0.068 # 6
S-measure 0.845 # 5
max F-measure 0.847 # 6
max E-measure 0.888 # 6
mean E-measure 0.884 # 5
mean F-measure 0.838 # 5
Co-Salient Object Detection CoSOD3k GCoNet S-measure 0.802 # 6
max E-measure 0.860 # 5
max F-measure 0.777 # 6
MAE 0.071 # 4
mean E-measure 0.857 # 4
mean F-measure 0.770 # 5

Methods