Multi-level Multiple Attentions for Contextual Multimodal Sentiment Analysis
Authors:
- Soujanya PoriaSPSoujanya Poria
- Erik CambriaErik Cambria
- Devamanyu HazarikaDHDevamanyu Hazarika
- Navonil MazumderNMNavonil Mazumder
- Amir ZadehAZAmir Zadeh
- Louis-Philippe MorencyLMLouis-Philippe Morency
- 1 November 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1033-1038
Abstract
Multimodal sentiment analysis involves identifying sentiment in videos and is a developing field of research. Unlike current works, which model utterances individually, we propose a recurrent model that is able to capture contextual information among utterances. In this paper, we also introduce attentionbased networks for improving both context learning and dynamic feature fusion. Our model shows 6-8% improvement over the state of the art on a benchmark dataset.Keywords
This publication has 8 references indexed in Scilit:
- A review of affective computing: From unimodal analysis to multimodal fusionInformation Fusion, 2017
- Context-Dependent Sentiment Analysis in User-Generated Videos2017
- Convolutional MKL Based Multimodal Emotion Recognition and Sentiment Analysis2016
- Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal MessagesIEEE Intelligent Systems, 2016
- Affective Computing and Sentiment AnalysisIEEE Intelligent Systems, 2016
- Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification2016
- Learning Spatiotemporal Features with 3D Convolutional Networks2015
- Deep Convolutional Neural Network Textual Features and Multiple Kernel Learning for Utterance-level Multimodal Sentiment Analysis2015