PoseTrack: Joint Multi-Person Pose Estimation and Tracking

CVPR 2017  ·  Umar Iqbal, Anton Milan, Juergen Gall ·

In this work, we introduce the challenging problem of joint multi-person pose estimation and tracking of an unknown number of persons in unconstrained videos. Existing methods for multi-person pose estimation in images cannot be applied directly to this problem, since it also requires to solve the problem of person association over time in addition to the pose estimation for each person. We therefore propose a novel method that jointly models multi-person pose estimation and tracking in a single formulation. To this end, we represent body joint detections in a video by a spatio-temporal graph and solve an integer linear program to partition the graph into sub-graphs that correspond to plausible body pose trajectories for each person. The proposed approach implicitly handles occlusion and truncation of persons. Since the problem has not been addressed quantitatively in the literature, we introduce a challenging "Multi-Person PoseTrack" dataset, and also propose a completely unconstrained evaluation protocol that does not make any assumptions about the scale, size, location or the number of persons. Finally, we evaluate the proposed approach and several baseline methods on our new dataset.

PDF Abstract CVPR 2017 PDF CVPR 2017 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Pose Tracking Multi-Person PoseTrack PoseTrack MOTA 28.2 # 1
MOTP 55.7 # 1
Multi-Person Pose Estimation Multi-Person PoseTrack PoseTrack Mean mAP 38.2 # 1

Methods


No methods listed for this paper. Add relevant methods here