HandAugment: A Simple Data Augmentation Method for Depth-Based 3D Hand Pose Estimation

3 Jan 2020  ·  Zhaohui Zhang, Shipeng Xie, Mingxiu Chen, Haichao Zhu ·

Hand pose estimation from 3D depth images, has been explored widely using various kinds of techniques in the field of computer vision. Though, deep learning based method improve the performance greatly recently, however, this problem still remains unsolved due to lack of large datasets, like ImageNet or effective data synthesis methods. In this paper, we propose HandAugment, a method to synthesize image data to augment the training process of the neural networks. Our method has two main parts: First, We propose a scheme of two-stage neural networks. This scheme can make the neural networks focus on the hand regions and thus to improve the performance. Second, we introduce a simple and effective method to synthesize data by combining real and synthetic image together in the image space. Finally, we show that our method achieves the first place in the task of depth-based 3D hand pose estimation in HANDS 2019 challenge.

PDF Abstract

Datasets


  Add Datasets introduced or used in this paper

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Hand Pose Estimation HANDS 2019 HandAugment Average 3D Error 13.66 # 2

Methods


No methods listed for this paper. Add relevant methods here