Aspect-Based Sentiment Analysis in Hindi Language by Ensembling Pre-Trained mBERT Models
Open Access
- 28 October 2021
- journal article
- research article
- Published by MDPI AG in Electronics
- Vol. 10 (21) , 2641
Abstract
Sentiment Analysis is becoming an essential task for academics, as well as for commercial companies. However, most current approaches only identify the overall polarity of a sentence, instead of the polarity of each aspect mentioned in the sentence. Aspect-Based Sentiment Analysis (ABSA) identifies the aspects within the given sentence, and the sentiment that was expressed for each aspect. Recently, the use of pre-trained models such as BERT has achieved state-of-the-art results in the field of natural language processing. In this paper, we propose two ensemble models based on multilingual-BERT, namely, mBERT-E-MV and mBERT-E-AS. Using different methods, we construct an auxiliary sentence from this aspect and convert the ABSA problem to a sentence-pair classification task. We then fine-tune different pre-trained BERT models and ensemble them for a final prediction based on the proposed model; we achieve new, state-of-the-art results for datasets belonging to different domains in the Hindi language.Keywords
This publication has 31 references indexed in Scilit:
- Aspect-based sentiment analysis using adaptive aspect-based lexiconsExpert Systems with Applications, 2020
- Movie Recommendation System Using Sentiment Analysis From Microblogging DataIEEE Transactions on Computational Social Systems, 2020
- Enhancing BERT Representation With Context-Aware Embedding for Aspect-Based Sentiment AnalysisIEEE Access, 2020
- Exploring Impact of Age and Gender on Sentiment Analysis Using Machine LearningElectronics, 2020
- Fusion of EEG response and sentiment analysis of products review to predict customer satisfactionInformation Fusion, 2019
- All-in-One: Emotion, Sentiment and Intensity Prediction Using a Multi-Task Ensemble FrameworkIEEE Transactions on Affective Computing, 2019
- Using a stacked residual LSTM model for sentiment intensity predictionNeurocomputing, 2018
- Prediction of advertisement preference by fusing EEG response and sentiment analysisNeural Networks, 2017
- Multilingual sentiment analysis: from formal to informal and scarce resource languagesArtificial Intelligence Review, 2016
- Affective Computing and Sentiment AnalysisIEEE Intelligent Systems, 2016