RepPoints V2: Verification Meets Regression for Object Detection

Verification and regression are two general methodologies for prediction in neural networks. Each has its own strengths: verification can be easier to infer accurately, and regression is more efficient and applicable to continuous target variables. Hence, it is often beneficial to carefully combine them to take advantage of their benefits. In this paper, we take this philosophy to improve state-of-the-art object detection, specifically by RepPoints. Though RepPoints provides high performance, we find that its heavy reliance on regression for object localization leaves room for improvement. We introduce verification tasks into the localization prediction of RepPoints, producing RepPoints v2, which provides consistent improvements of about 2.0 mAP over the original RepPoints on the COCO object detection benchmark using different backbones and training methods. RepPoints v2 also achieves 52.1 mAP on COCO \texttt{test-dev} by a single model. Moreover, we show that the proposed approach can more generally elevate other object detection frameworks as well as applications such as instance segmentation. The code is available at https://github.com/Scalsol/RepPointsV2.

PDF Abstract NeurIPS 2020 PDF NeurIPS 2020 Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Object Detection COCO-O RepPointsV2 (RX-101-64x4d-DCN) Average mAP 24.9 # 27
Effective Robustness 2.7 # 26
Object Detection COCO test-dev RepPoints v2 (ResNeXt-101, DCN, multi-scale) box mAP 52.1 # 70
AP50 70.1 # 34
AP75 57.5 # 27
APS 34.5 # 20
APM 54.6 # 30
APL 63.6 # 32
Hardware Burden None # 1
Operations per network pass None # 1
Object Detection COCO test-dev RepPoints v2 (ResNeXt-101, DCN) box mAP 49.4 # 90
AP50 68.9 # 45
AP75 53.4 # 49
APS 30.3 # 46
APM 52.1 # 45
APL 62.3 # 39
Hardware Burden None # 1
Operations per network pass None # 1

Methods