Bidirectional Learning for Domain Adaptation of Semantic Segmentation

CVPR 2019  ·  Yunsheng Li, Lu Yuan, Nuno Vasconcelos ·

Domain adaptation for semantic image segmentation is very necessary since manually labeling large datasets with pixel-level labels is expensive and time consuming. Existing domain adaptation techniques either work on limited datasets, or yield not so good performance compared with supervised learning. In this paper, we propose a novel bidirectional learning framework for domain adaptation of segmentation. Using the bidirectional learning, the image translation model and the segmentation adaptation model can be learned alternatively and promote to each other. Furthermore, we propose a self-supervised learning algorithm to learn a better segmentation adaptation model and in return improve the image translation model. Experiments show that our method is superior to the state-of-the-art methods in domain adaptation of segmentation with a big margin. The source code is available at https://github.com/liyunsheng13/BDL.

PDF Abstract CVPR 2019 PDF CVPR 2019 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Semantic Segmentation DADA-seg BDL mIoU 29.66 # 7
Synthetic-to-Real Translation GTAV-to-Cityscapes Labels BDL mIoU 48.5 # 50
Image-to-Image Translation GTAV-to-Cityscapes Labels Bidirectional Learning mIoU 41.3 # 21
Image-to-Image Translation SYNTHIA-to-Cityscapes Bidirectional Learning (ResNet-101) mIoU (13 classes) 51.4 # 16

Methods


No methods listed for this paper. Add relevant methods here