Emotional Attention Detection and Correlation Exploration for Image Emotion Distribution Learning
- 6 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Affective Computing
- Vol. 14 (1) , 357-369
Abstract
Current works on image emotion distribution learning typically extract visual representations from the holistic image or explore emotion-related regions in the image from a global-wise perspective. However, different regions of an image contribute differently to the arousal of each emotion. Existing works do not deeply explore corresponding emotion-aware regions of each emotion in the image, nor do they fully capture the relationship between each emotion-aware region and the emotion labels. In this paper, we propose a novel attention based emotion distribution learning method, which can explore the emotion-related regions of images from the perspective of each emotion category, and can conduct region relationship learning. Specifically, we introduce a semantic guided attention detection network to generate class-wise attention maps for each emotion and a global-wise attention map for the holistic image. Meanwhile, an emotional graph-based network is adopted to capture the correlation between each region and the emotion distribution. Experiments on several benchmark datasets demonstrate the superiority of the proposed method compared to related works.Keywords
Funding Information
- Anhui Science and Technology Agency (1804a09020038)
- National Natural Science Foundation of China (917418129, 92048203)
This publication has 53 references indexed in Scilit:
- Object-Based Visual Sentiment Concept Analysis and Application2014
- Exploring Principles-of-Art Features For Image Emotion Recognition2014
- Glove: Global Vectors for Word Representation2014
- Large-scale visual sentiment ontology and detectors using adjective noun pairs2013
- The integrated mobile advertising model: The effects of technology- and emotion-based evaluationsJournal of Business Research, 2013
- Facial Age Estimation by Learning from Label DistributionsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- A multi-layer hybrid framework for dimensional emotion classification2011
- Color Based Bags-of-Emotions2009
- Identifying Expressions of Emotion in Text2007
- Inducing features of random fieldsIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997