Camouflaged Object Segmentation with Distraction Mining

Camouflaged object segmentation (COS) aims to identify objects that are "perfectly" assimilate into their surroundings, which has a wide range of valuable applications. The key challenge of COS is that there exist high intrinsic similarities between the candidate objects and noise background. In this paper, we strive to embrace challenges towards effective and efficient COS. To this end, we develop a bio-inspired framework, termed Positioning and Focus Network (PFNet), which mimics the process of predation in nature. Specifically, our PFNet contains two key modules, i.e., the positioning module (PM) and the focus module (FM). The PM is designed to mimic the detection process in predation for positioning the potential target objects from a global perspective and the FM is then used to perform the identification process in predation for progressively refining the coarse prediction via focusing on the ambiguous regions. Notably, in the FM, we develop a novel distraction mining strategy for distraction discovery and removal, to benefit the performance of estimation. Extensive experiments demonstrate that our PFNet runs in real-time (72 FPS) and significantly outperforms 18 cutting-edge models on three challenging datasets under four standard metrics.

PDF Abstract CVPR 2021 PDF CVPR 2021 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Dichotomous Image Segmentation DIS-TE1 PFNet max F-Measure 0.646 # 12
weighted F-measure 0.552 # 13
MAE 0.094 # 12
S-Measure 0.722 # 14
E-measure 0.786 # 13
HCE 253 # 14
Dichotomous Image Segmentation DIS-TE2 PFNet max F-Measure 0.720 # 12
weighted F-measure 0.633 # 12
MAE 0.096 # 13
S-Measure 0.761 # 12
E-measure 0.829 # 11
HCE 567 # 15
Dichotomous Image Segmentation DIS-TE3 PFNet max F-Measure 0.751 # 12
weighted F-measure 0.664 # 11
MAE 0.092 # 13
S-Measure 0.777 # 11
E-measure 0.854 # 12
HCE 1082 # 16
Dichotomous Image Segmentation DIS-TE4 PFNet max F-Measure 0.731 # 13
weighted F-measure 0.647 # 14
MAE 0.107 # 14
S-Measure 0.763 # 12
E-measure 0.838 # 12
HCE 3803 # 15
Dichotomous Image Segmentation DIS-VD PFNet max F-Measure 0.691 # 14
weighted F-measure 0.604 # 12
MAE 0.106 # 13
S-Measure 0.740 # 14
E-measure 0.811 # 11
HCE 1606 # 18

Methods


No methods listed for this paper. Add relevant methods here