PointVector: A Vector Representation In Point Cloud Analysis

CVPR 2023  ยท  Xin Deng, Wenyu Zhang, Qing Ding, Xinming Zhang ยท

In point cloud analysis, point-based methods have rapidly developed in recent years. These methods have recently focused on concise MLP structures, such as PointNeXt, which have demonstrated competitiveness with Convolutional and Transformer structures. However, standard MLPs are limited in their ability to extract local features effectively. To address this limitation, we propose a Vector-oriented Point Set Abstraction that can aggregate neighboring features through higher-dimensional vectors. To facilitate network optimization, we construct a transformation from scalar to vector using independent angles based on 3D vector rotations. Finally, we develop a PointVector model that follows the structure of PointNeXt. Our experimental results demonstrate that PointVector achieves state-of-the-art performance $\textbf{72.3\% mIOU}$ on the S3DIS Area 5 and $\textbf{78.4\% mIOU}$ on the S3DIS (6-fold cross-validation) with only $\textbf{58\%}$ model parameters of PointNeXt. We hope our work will help the exploration of concise and effective feature representations. The code will be released soon.

PDF Abstract CVPR 2023 PDF CVPR 2023 Abstract
Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
3D Point Cloud Classification ModelNet40 PointVector-S Overall Accuracy 93.5 # 48
Mean Accuracy 91 # 20
3D Semantic Segmentation OpenTrench3D PointVector-XL mIoU 76.5 # 1
mAcc 84.1 # 2
Model Size 24.1M # 2
Semantic Segmentation S3DIS PointVector-XL Mean IoU 78.4 # 4
mAcc 86.1 # 4
oAcc 91.9 # 5
Params (M) 24.1 # 4
Semantic Segmentation S3DIS Area5 PointVector-XL mIoU 72.3 # 13
oAcc 91 # 15
mAcc 78.1 # 11
3D Point Cloud Classification ScanObjectNN PointVector-S Overall Accuracy 87.8 # 30
Mean Accuracy 86.2 # 12
3D Part Segmentation ShapeNet-Part PointVector-S(C=64) Instance Average IoU 86.9 # 6

Methods