Joint Skeletal and Semantic Embedding Loss for Micro-gesture Classification

20 Jul 2023  ·  Kun Li, Dan Guo, Guoliang Chen, Xinge Peng, Meng Wang ·

In this paper, we briefly introduce the solution of our team HFUT-VUT for the Micros-gesture Classification in the MiGA challenge at IJCAI 2023. The micro-gesture classification task aims at recognizing the action category of a given video based on the skeleton data. For this task, we propose a 3D-CNNs-based micro-gesture recognition network, which incorporates a skeletal and semantic embedding loss to improve action classification performance. Finally, we rank 1st in the Micro-gesture Classification Challenge, surpassing the second-place team in terms of Top-1 accuracy by 1.10%.

PDF Abstract

Datasets


Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Result Benchmark
Micro-gesture Recognition iMiGUE Top 1 Accuracy 64.12 # 1
Top 5 Accuracy 91.1 # 1

Methods


No methods listed for this paper. Add relevant methods here