GPV-Pose: Category-level Object Pose Estimation via Geometry-guided Point-wise Voting

While 6D object pose estimation has recently made a huge leap forward, most methods can still only handle a single or a handful of different objects, which limits their applications. To circumvent this problem, category-level object pose estimation has recently been revamped, which aims at predicting the 6D pose as well as the 3D metric size for previously unseen instances from a given set of object classes. This is, however, a much more challenging task due to severe intra-class shape variations. To address this issue, we propose GPV-Pose, a novel framework for robust category-level pose estimation, harnessing geometric insights to enhance the learning of category-level pose-sensitive features. First, we introduce a decoupled confidence-driven rotation representation, which allows geometry-aware recovery of the associated rotation matrix. Second, we propose a novel geometry-guided point-wise voting paradigm for robust retrieval of the 3D object bounding box. Finally, leveraging these different output streams, we can enforce several geometric consistency terms, further increasing performance, especially for non-symmetric categories. GPV-Pose produces superior results to state-of-the-art competitors on common public benchmarks, whilst almost achieving real-time inference speed at 20 FPS.

PDF Abstract CVPR 2022 PDF CVPR 2022 Abstract

Datasets


Results from the Paper


 Ranked #1 on 6D Pose Estimation on LineMOD (Mean ADD-S metric)

     Get a GitHub badge
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
6D Pose Estimation LineMOD GPV-Pose Mean ADD-S 98.2 # 1
6D Pose Estimation using RGBD REAL275 GPV-Pose mAP 10, 10cm 74.6 # 1
mAP 10, 5cm 73.3 # 3
mAP 3DIou@25 84.2 # 5
mAP 3DIou@50 83 # 2
mAP 5, 5cm 42.9 # 4
mAP 3DIou@75 64.4 # 2
mAP 5, 2cm 32 # 3
FPS 20 # 1

Methods