InstaBoost: Boosting Instance Segmentation via Probability Map Guided Copy-Pasting

Instance segmentation requires a large number of training samples to achieve satisfactory performance and benefits from proper data augmentation. To enlarge the training set and increase the diversity, previous methods have investigated using data annotation from other domain (e.g. bbox, point) in a weakly supervised mechanism. In this paper, we present a simple, efficient and effective method to augment the training set using the existing instance mask annotations. Exploiting the pixel redundancy of the background, we are able to improve the performance of Mask R-CNN for 1.7 mAP on COCO dataset and 3.3 mAP on Pascal VOC dataset by simply introducing random jittering to objects. Furthermore, we propose a location probability map based approach to explore the feasible locations that objects can be placed based on local appearance similarity. With the guidance of such map, we boost the performance of R101-Mask R-CNN on instance segmentation from 35.7 mAP to 37.9 mAP without modifying the backbone or network structure. Our method is simple to implement and does not increase the computational complexity. It can be integrated into the training pipeline of any instance segmentation model without affecting the training and inference efficiency. Our code and models have been released at https://github.com/GothicAi/InstaBoost

PDF Abstract ICCV 2019 PDF ICCV 2019 Abstract

Datasets


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Object Detection COCO test-dev Cascade R-CNN-FPN (ResNet-101, map-guided) box mAP 45.9 # 129
AP50 64.2 # 89
AP75 50 # 77
APS 26.3 # 84
APM 49 # 66
APL 58.6 # 65
Hardware Burden None # 1
Operations per network pass None # 1
Instance Segmentation COCO test-dev Cascade R-CNN (ResNet-101-FPN, map-guided) mask AP 39.5% # 78
AP50 61.4% # 24
AP75 42.9% # 19
APS 21.2% # 21
APM 42.5% # 19
APL 52.1% # 25

Methods