Make Acoustic and Visual Cues Matter: CH-SIMS v2.0 Dataset and AV-Mixup Consistent Module

1 code implementation • 22 Aug 2022 • Yihe Liu, Ziqi Yuan, Huisheng Mao, Zhiyun Liang, Wanqiuyue Yang, Yuanzhe Qiu, Tie Cheng, Xiaoteng Li, Hua Xu, Kai Gao

The designed modality mixup module can be regarded as an augmentation, which mixes the acoustic and visual modalities from different videos.

Multimodal Sentiment Analysis