I-GCN: Incremental Graph Convolution Network for Conversation Emotion Detection
- 8 October 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 24 (15209210) , 4471-4481
Abstract
Sentiment analysis and emotion detection in conversation are becoming hot topics in regard to several applications. With the development of the social robot, social network, and intelligent voice assistant, emotion detection is attracting more attention as a key component in these research fields. Many approaches have been proposed to handle this problem in recent years. However, these previous approaches focus on either the temporal change information of the conversation or the semantic correlation information of the dialogue but ignore the combination of temporal information and semantic correlation information. In this paper, we propose an incremental graph convolution network (I-GCN) to handle emotion detection in conversation. We first utilize the graph structure to represent conversation at different times, which can represent the semantic correlation information of utterances. Then, we apply the incremental graph structure to imitate the process of dynamic conversation, which can preserve the temporal change information of conversation. Especially, for the first step of the process, we creatively propose utterance-level GCN (U-GCN) and speaker-level GCN (S-GCN) to learn the features of utterances for emotion detection. U-GCN focuses on the correlations among utterances and applies the multi-head attention model to find latent correlation information among utterances, which aims to further enhance the guidance of semantic relevance for feature learning. S-GCN focuses on the correlation between speaker and utterances, which can provide a different angle to guide the feature learning of utterances. In the learning of model parameters, we constantly utilize the new utterances to fine-tune the parameters of GNN for enhancement of the contribution of temporal change information. Detailed evaluations of the proposed method on three published conversation corpuses demonstrate the great effectiveness of our approach over several conventional competitive baselines.Keywords
Funding Information
- National Natural Science Foundation of China (61872267, 61702471, 61772359)
- Tianjin New Generation Artificial Intelligence Major Program (18ZXZNGX00150, 19ZXZNGX00110)
- Open Project Program of the State Key Laboratory of CAD & CG, Zhejiang University (A2005, A2012)
- Tianjin Science Foundation for Young Scientists of China (19JCQNJC00500)
This publication has 31 references indexed in Scilit:
- Dynamic graph convolutional networksPattern Recognition, 2020
- Movie Question Answering via Textual Memory and Plot GraphIEEE Transactions on Circuits and Systems for Video Technology, 2019
- ICON: Interactive Conversational Memory Network for Multimodal Emotion Detection2018
- Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos2018
- Context-Dependent Sentiment Analysis in User-Generated Videos2017
- Tensor Fusion Network for Multimodal Sentiment Analysis2017
- Compact and Discriminative Descriptor Inference Using Multi-CuesIEEE Transactions on Image Processing, 2015
- Convolutional Neural Networks for Sentence Classification2014
- IEMOCAP: interactive emotional dyadic motion capture databaseLanguage Resources and Evaluation, 2008
- Long Short-Term MemoryNeural Computation, 1997