Prediction of emotion distribution of images based on weighted K-nearest neighbor-attention mechanism
Author:
Open Access
- 17 April 2024
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Computational Neuroscience
- Vol. 18, 1350916
Abstract
Existing methods for classifying image emotions often overlook the subjective impact emotions evoke in observers, focusing primarily on emotion categories. However, this approach falls short in meeting practical needs as it neglects the nuanced emotional responses captured within an image. This study proposes a novel approach employing the weighted closest neighbor algorithm to predict the discrete distribution of emotion in abstract paintings. Initially, emotional features are extracted from the images and assigned varying K-values. Subsequently, an encoder-decoder architecture is utilized to derive sentiment features from abstract paintings, augmented by a pre-trained model to enhance classification model generalization and convergence speed. By incorporating a blank attention mechanism into the decoder and integrating it with the encoder's output sequence, the semantics of abstract painting images are learned, facilitating precise and sensible emotional understanding. Experimental results demonstrate that the classification algorithm, utilizing the attention mechanism, achieves a higher accuracy of 80.7% compared to current methods. This innovative approach successfully addresses the intricate challenge of discerning emotions in abstract paintings, underscoring the significance of considering subjective emotional responses in image classification. The integration of advanced techniques such as weighted closest neighbor algorithm and attention mechanisms holds promise for enhancing the comprehension and classification of emotional content in visual art.Keywords
This publication has 33 references indexed in Scilit:
- Improving Deep Learning-based Plant Disease Classification with Attention MechanismGesunde Pflanzen, 2022
- CovidViT: a novel neural network with self-attention mechanism to detect Covid-19 through X-ray imagesInternational Journal of Machine Learning and Cybernetics, 2022
- A survey on deep learning for textual emotion analysis in social networksDigital Communications and Networks, 2022
- A compact periocular recognition system based on deep learning framework AttenMidNet with the attention mechanismMultimedia Tools and Applications, 2022
- Retinex low-light image enhancement network based on attention mechanismMultimedia Tools and Applications, 2022
- A Skin Cancer Classification Approach using GAN and RoI-Based Attention MechanismJournal of Signal Processing Systems, 2022
- State of the art: a review of sentiment analysis based on sequential transfer learningArtificial Intelligence Review, 2022
- Emotion recognition based on convolutional neural networks and heterogeneous bio-signal data sourcesInformation Fusion, 2022
- Deep learning of individual aestheticsNeural Computing and Applications, 2020
- The influence of the physical context and knowledge of artworks on the aesthetic experience of interactive installationsCurrent Psychology, 2019