Gradient-Induced Co-Saliency Detection

ECCV 2020  ·  Zhao Zhang, Wenda Jin, Jun Xu, Ming-Ming Cheng ·

Co-saliency detection (Co-SOD) aims to segment the common salient foreground in a group of relevant images. In this paper, inspired by human behavior, we propose a gradient-induced co-saliency detection (GICD) method. We first abstract a consensus representation for the grouped images in the embedding space; then, by comparing the single image with consensus representation, we utilize the feedback gradient information to induce more attention to the discriminative co-salient features. In addition, due to the lack of Co-SOD training data, we design a jigsaw training strategy, with which Co-SOD networks can be trained on general saliency datasets without extra pixel-level annotations. To evaluate the performance of Co-SOD methods on discovering the co-salient object among multiple foregrounds, we construct a challenging CoCA dataset, where each image contains at least one extraneous foreground along with the co-salient object. Experiments demonstrate that our GICD achieves state-of-the-art performance. Our codes and dataset are available at https://mmcheng.net/gicd/.

PDF Abstract ECCV 2020 PDF ECCV 2020 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Co-Salient Object Detection CoCA GICD S-measure 0.658 # 7
max F-measure 0.513 # 7
mean E-measure 0.701 # 6
Mean F-measure 0.504 # 6
max E-measure 0.715 # 8
MAE 0.126 # 7
Co-Salient Object Detection CoSal2015 GICD MAE 0.071 # 7
S-measure 0.844 # 6
max F-measure 0.844 # 7
max E-measure 0.887 # 7
mean E-measure 0.883 # 6
mean F-measure 0.835 # 6
Co-Salient Object Detection CoSOD3k GICD S-measure 0.797 # 7
max E-measure 0.848 # 7
max F-measure 0.770 # 7
MAE 0.079 # 6
mean E-measure 0.845 # 6
mean F-measure 0.763 # 6

Methods