ABSA of Indonesian customer reviews using IndoBERT: single- sentence and sentence-pair classification approaches
Open Access
- 1 October 2024
- journal article
- Published by Institute of Advanced Engineering and Science in Bulletin of Electrical Engineering and Informatics
- Vol. 13 (5) , 3579-3589
Abstract
Aspect-based sentiment analysis (ABSA) task is important to identify user satisfaction from customer reviews by recognizing the sentiments of all aspects discussed in the reviews. This work investigates a novel study on the effectiveness and efficiency of three IndoBERT-based models for solving the ABSA task in Indonesian language. IndoBERT is a state-of-the-art transformer-based model, i.e., bidirectional encoder representations from transformers (BERT), that was pre-trained on Indonesian language. Our first model utilizes IndoBERT in a feature-based mode, paired with the convolutional neural network (CNN) and machine learning models, for single-sentence classification. Next, our second model is obtained by fine- tuning the IndoBERT model for a typical single-sentence classification to build an end-to-end model. At last, our third model also adopts a fine-tuning approach to use IndoBERT, but for sentence-pair classification by utilizing auxiliary sentences. Our results demonstrate that the third model, the fine- tuned IndoBERT for sentence-pair classification, gains the highest effectiveness. It demonstrates significant improvement over deep learning baselines (Word2Vec-CNN-XGBoost) by 23.6% and transformer-based baselines (mBERT-aux-NLIB) by 2.2% in terms of F-1 score. When considering both effectiveness and efficiency, the results show that the best- performing model is our second model, the fine-tuned IndoBERT for single- sentence classification.Keywords
This publication has 29 references indexed in Scilit:
- Comparative Analysis on Aspect-based Sentiment using BERT2023
- Aspect-Based Sentiment Analysis with Semi-Supervised Approach on Taiwan Social Distancing App User Reviews2023
- SA-ASBA: a hybrid model for aspect-based sentiment analysis using synthetic attention in pre-trained language BERT model with extreme gradient boostingThe Journal of Supercomputing, 2022
- Aspect-Based Sentiment Analysis in Beauty Product Reviews Using TF-IDF and SVM Algorithm2021
- Fine-tuning Pretrained Multilingual BERT Model for Indonesian Aspect-based Sentiment Analysis2020
- Aspect-Based Sentiment Analysis Using a Hybridized Approach Based on CNN and GAIEEE Access, 2020
- Enhancing BERT Representation With Context-Aware Embedding for Aspect-Based Sentiment AnalysisIEEE Access, 2020
- Multi-label Aspect Categorization with Convolutional Neural Networks and Extreme Gradient Boosting2019
- Aspect Detection and Sentiment Classification Using Deep Neural Network for Indonesian Aspect-Based Sentiment Analysis2018
- A Linguistic Rule-Based Approach for Aspect-Level Sentiment Analysis of Movie Reviews2017