Semi-Supervised Semantic Segmentation with Cross Pseudo Supervision

In this paper, we study the semi-supervised semantic segmentation problem via exploring both labeled data and extra unlabeled data. We propose a novel consistency regularization approach, called cross pseudo supervision (CPS). Our approach imposes the consistency on two segmentation networks perturbed with different initialization for the same input image. The pseudo one-hot label map, output from one perturbed segmentation network, is used to supervise the other segmentation network with the standard cross-entropy loss, and vice versa. The CPS consistency has two roles: encourage high similarity between the predictions of two perturbed networks for the same input image, and expand training data by using the unlabeled data with pseudo labels. Experiment results show that our approach achieves the state-of-the-art semi-supervised segmentation performance on Cityscapes and PASCAL VOC 2012. Code is available at https://git.io/CPS.

PDF Abstract CVPR 2021 PDF CVPR 2021 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Semi-Supervised Semantic Segmentation Cityscapes 12.5% labeled CPS (DeepLab v3+ with ImageNet-pretrained ResNet-101, single scale inference) Validation mIoU 77.62% # 6
Semi-Supervised Semantic Segmentation Cityscapes 25% labeled CPS (DeepLab v3+ with ImageNet-pretrained ResNet-101, single scale inference) Validation mIoU 79.21% # 5
Semi-Supervised Semantic Segmentation Cityscapes 50% labeled CPS (DeepLab v3+ with ImageNet-pretrained ResNet-101, single scale inference) Validation mIoU 80.21% # 4
Semi-Supervised Semantic Segmentation Cityscapes 6.25% labeled CPS (DeepLab v3+ with ResNet-101) Validation mIoU 69.8 # 12
Semi-Supervised Semantic Segmentation nuScenes CPS (Range View) mIoU (1% Labels) 40.7 # 8
mIoU (10% Labels) 60.8 # 6
mIoU (20% Labels) 64.9 # 6
mIoU (50% Labels) 68.0 # 8
Semi-Supervised Semantic Segmentation Pascal VOC 2012 12.5% labeled CPS Validation mIoU 76.44% # 9
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 183 labeled CPS (DeepLab v3+ with ResNet-101) Validation mIoU 67.4 # 7
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 25% labeled CPS (DeepLab v3+ with ImageNet-pretrained ResNet-101, single scale inference) Validation mIoU 77.68% # 10
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 366 labeled CPS (DeepLab v3+ with ResNet-101) Validation mIoU 71.7 # 8
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 732 labeled CPS (DeepLab v3+ with ResNet-101) Validation mIoU 75.9 # 7
Semi-Supervised Semantic Segmentation PASCAL VOC 2012 92 labeled CPS (DeepLab v3+ with ResNet-101) Validation mIoU 64.1 # 7
Semi-Supervised Semantic Segmentation ScribbleKITTI CPS (Range View) mIoU (1% Labels) 33.7 # 8
mIoU (10% Labels) 50.0 # 6
mIoU (20% Labels) 52.8 # 4
mIoU (50% Labels) 54.6 # 3
Semi-Supervised Semantic Segmentation SemanticKITTI CPS (Range View) mIoU (1% Labels) 36.5 # 9
mIoU (10% Labels) 52.3 # 9
mIoU (20% Labels) 56.3 # 6
mIoU (50% Labels) 57.4 # 7
Semi-Supervised Semantic Segmentation WoodScape CPS Mean IoU 62.87 # 2

Methods


No methods listed for this paper. Add relevant methods here