Multidimensional Extra Evidence Mining for Image Sentiment Analysis

Authors:

Abstract
Image sentiment analysis is a hot research topic in the field of computer vision. However, two key issues need to be addressed. First, high-quality training samples are scarce. There are numerous ambiguous images in the original datasets owing to diverse subjective cognitions from different annotators. Second, the cross-modal sentimental semantics among heterogeneous image features has not been fully explored. To alleviate these problems, we propose a novel model called multidimensional extra evidence mining (ME2M) for image sentiment analysis, it involves sample-refinement and cross-modal sentimental semantics mining. A new soft voting-based sample-refinement strategy is designed to address the former problem, whereas the state-of-the-art discriminant correlation analysis (DCA) model is used to completely mine the cross-modal sentimental semantics among diverse image features. Image sentiment analysis is conducted based on the cross-modal sentimental semantics and a general classifier. The experimental results verify that the ME2M model is effective and robust and that it outperforms the most competitive baselines on two well-known datasets. Furthermore, it is versatile owing to its flexible structure.
Funding Information
  • National Natural Science Foundation of China (61762038, 61861016)
  • Jiangxi Provincial Department of Science and Technology (20171BAB202023, 20192ACB21004)
  • Key Research and Development Plan of the Jiangxi Provincial Science and Technology Department (20171BBG70093, 20192BBE50071)
  • Humanity and Social Fund of Ministry of Education of China (17YJAZH117, 20YJAZH142)
  • Humanity and Social Science Foundation of Jiangxi University (TQ19101)
  • Science and Technology Projects of the Jiangxi Provincial Department of Education (GJJ180320, GJJ190323)
  • Foundation of Guizhou Provincial Key Laboratory of Public Big Data (2018BDKFJJ011)

This publication has 38 references indexed in Scilit: