IMG2IMU: Translating Knowledge from Large-Scale Images to IMU Sensing Applications

no code implementations • 2 Sep 2022 • Hyungjun Yoon, Hyeongheon Cha, Hoang C. Nguyen, Taesik Gong, Sung-Ju Lee

Our evaluation with four different IMU sensing tasks shows that IMG2IMU outperforms the baselines pre-trained on sensor data by an average of 9. 6%p F1-score, illustrating that vision knowledge can be usefully incorporated into IMU sensing applications where only limited training data is available.

Contrastive Learning Few-Shot Learning +1