RMPE: Regional Multi-person Pose Estimation

ICCV 2017  ยท  Hao-Shu Fang, Shuqin Xie, Yu-Wing Tai, Cewu Lu ยท

Multi-person pose estimation in the wild is challenging. Although state-of-the-art human detectors have demonstrated good performance, small errors in localization and recognition are inevitable. These errors can cause failures for a single-person pose estimator (SPPE), especially for methods that solely depend on human detection results. In this paper, we propose a novel regional multi-person pose estimation (RMPE) framework to facilitate pose estimation in the presence of inaccurate human bounding boxes. Our framework consists of three components: Symmetric Spatial Transformer Network (SSTN), Parametric Pose Non-Maximum-Suppression (NMS), and Pose-Guided Proposals Generator (PGPG). Our method is able to handle inaccurate bounding boxes and redundant detections, allowing it to achieve a 17% increase in mAP over the state-of-the-art methods on the MPII (multi person) dataset.Our model and source codes are publicly available.

PDF Abstract ICCV 2017 PDF ICCV 2017 Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Result Benchmark
Pose Estimation COCO test-dev RMPE++ AP 72.3 # 26
AP50 89.2 # 33
AP75 79.1 # 25
APL 78.6 # 20
APM 68.0 # 23
Pose Estimation COCO test-dev RMPE AP 61.8 # 43
AP50 83.7 # 41
AP75 69.8 # 37
APL 67.6 # 40
APM 58.6 # 33
Keypoint Detection COCO test-dev AlphaPose APL 81.5 # 3
Multi-Person Pose Estimation COCO test-dev RMPE AP 61.8 # 14
APL 67.6 # 11
APM 58.6 # 10
AP50 83.7 # 9
AP75 69.8 # 8
Keypoint Detection MPII Multi-Person AlphaPose mAP@0.5 82.1% # 1
Multi-Person Pose Estimation MPII Multi-Person AlphaPose AP 82.1% # 1
Keypoint Detection MS COCO AlphaPose Test AP 73.3 # 11
FPS 23 # 1
2D Human Pose Estimation OCHuman RMPE Test AP 30.7 # 7
Validation AP 38.8 # 5
Keypoint Detection OCHuman RMPE Test AP 30.7 # 6
Validation AP 38.8 # 5
Pose Estimation OCHuman RMPE Test AP 30.7 # 10
Validation AP 38.8 # 9
Pose Estimation UAV-Human AlphaPose mAP 56.9 # 1

Results from Other Papers


Task Dataset Model Metric Name Metric Value Rank Uses Extra
Training Data
Source Paper Compare
Multi-Person Pose Estimation CrowdPose AlphaPose mAP @0.5:0.95 61.0 # 17
AP Easy 71.2 # 15
AP Medium 61.4 # 16
AP Hard 51.1 # 16

Methods