Hybrid grass bee optimization‐multikernal extreme learning classifier: Multimodular fusion strategy and optimal feature selection for multimodal sentiment analysis in social media videos
- 4 April 2021
- journal article
- research article
- Published by Wiley in Concurrency and Computation: Practice and Experience
- Vol. 33 (16) , e6259
Abstract
Presently, large recordings like audio and video are uploaded each day on the public networks particularly Facebook, YouTube, etc. Such postings generate unlimited data via the Internet. Over the next few decades adapting and dealing with data mining to obtain relevant details from social media is considered as a difficult task. To tackle these challenges, a novel text‐audio‐video consistency‐driven multimodal sentiment analysis method is proposed in this paper. This proposed system examines the correlation among the text, audio and video followed by multimodal sentiment analysis. A different set of features are extracted and then the extracted features are chosen optimally by employing a new hybrid grass bee optimization algorithm (HGBEE) thus obtaining a feature set containing an optimal value for better precision and low computational time. Then an utterance level multimodular fusion regarding text, audio, and video features is developed. Finally, the proposed multikernal extreme learning classifier (MKELM) is employed for sentiment classification. Then the proposed system is evaluated by testing with three multimodal datasets in terms of precision, accuracy, recall, and F‐measure, respectively. From the simulation, it is clear that the proposed system accomplishes the maximum classification accuracy value of 98.3% with minimum computation time. The implementation of our proposed approach is done under the MATLAB platform.Keywords
This publication has 46 references indexed in Scilit:
- Grasshopper Optimisation Algorithm: Theory and applicationAdvances in Engineering Software, 2017
- A Hybrid Approach for Web Document Clustering Using K-means and Artificial Bee Colony AlgorithmInternational Journal of Intelligent Engineering and Systems, 2016
- Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal MessagesIEEE Intelligent Systems, 2016
- An Efficient Threshold Prediction Scheme for Wavelet Based ECG Signal Noise Reduction Using Variable Step Size Firefly AlgorithmInternational Journal of Intelligent Engineering and Systems, 2016
- Affective Computing and Sentiment AnalysisIEEE Intelligent Systems, 2016
- Fusing audio, visual and textual clues for sentiment analysis from multimodal contentNeurocomputing, 2016
- Multi-modal feature fusion for action recognition in RGB-D sequences2014
- Learning Actionlet Ensemble for 3D Human Action Recognition2014
- Multimodal social intelligence in a real-time dashboard systemThe VLDB Journal, 2010
- IEMOCAP: interactive emotional dyadic motion capture databaseLanguage Resources and Evaluation, 2008