Xinhui Hu
Xinhui Hu has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Desheng Hu
Hithink RoyalFlush AI Research Institute, HangZhou, China
1 shared publication - Jiajun He
Graduate School of Informatics, Nagoya University, Nagoya, Japan
1 shared publication - Jingguang Tian
Hithink RoyalFlush AI Research Institute, HangZhou, China
1 shared publication - Tomoki Toda
Information Technology Center, Nagoya University, Nagoya, Japan
1 shared publication - Xiaohan Shi
Nagoya University, Nagoya, Japan
1 shared publication - Xingfeng Li
Faculty of Data Science, City University of Macau, Macao, China
1 shared publication
Latest Publications
- Open Access
- 29 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 67-73
Semi-supervised Multimodal Emotion Recognition with Consensus Decision-making and Label Correction
Multimodal emotion recognition is the task of identifying and understanding emotions by integrating information from multiple modalities, such as audio, visual, and textual data. However, the scarcity of labeled data poses a significant challenge for this task. To this end, this paper proposes a novel approach via a semi-supervised learning framework by incorporating consensus decision-making and label correction methods. Firstly, we employ supervised learning on the trimodal input data to establish robust initial models. Secondly, we generate reliable pseudo-labels for unlabelled data by leveraging consensus decision-making and label correction methods. Thirdly, we train the model in a supervised manner using both labeled and pseudo-labeled data. Moreover, the process of generating pseudo-labels and semi-supervised learning can be iterated to refine the model further. Experimental results on the MER 2023 dataset show the effectiveness of our proposed framework, achieving significant improvement on the MER-MULTI, MER-NOISE, and MER-SEMI subsets, respectively.
- 29 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 67-73
Open AccessSemi-supervised Multimodal Emotion Recognition with Consensus Decision-making and Label Correction
Multimodal emotion recognition is the task of identifying and understanding emotions by integrating information from multiple modalities, such as audio, visual, and textual data. However, the scarcity of labeled data poses a significant challenge for this task. To this end, this paper proposes a novel approach via a semi-supervised learning framework by incorporating consensus decision-making and label correction methods. Firstly, we employ supervised learning on the trimodal input data to establish robust initial models. Secondly, we generate reliable pseudo-labels for unlabelled data by leveraging consensus decision-making and label correction methods. Thirdly, we train the model in a supervised manner using both labeled and pseudo-labeled data. Moreover, the process of generating pseudo-labels and semi-supervised learning can be iterated to refine the model further. Experimental results on the MER 2023 dataset show the effectiveness of our proposed framework, achieving significant improvement on the MER-MULTI, MER-NOISE, and MER-SEMI subsets, respectively.