Enhanced sentiment analysis based on improved word embeddings and XGboost
Open Access
- 1 April 2023
- journal article
- research article
- Published by Institute of Advanced Engineering and Science in International Journal of Electrical and Computer Engineering (IJECE)
- Vol. 13 (2) , 1827-1836
Abstract
Sentiment analysis is a well-known and rapidly expanding study topic in natural language processing (NLP) and text classification. This approach has evolved into a critical component of many applications, including politics, business, advertising, and marketing. Most current research focuses on obtaining sentiment features through lexical and syntactic analysis. Word embeddings explicitly express these characteristics. This article proposes a novel method, improved words vector for sentiments analysis (IWVS), using XGboost to improve the F1-score of sentiment classification. The proposed method constructed sentiment vectors by averaging the word embeddings (Sentiment2Vec). We also investigated the Polarized lexicon for classifying positive and negative sentiments. The sentiment vectors formed a feature space to which the examined sentiment text was mapped to. Those features were input into the chosen classifier (XGboost). We compared the F1-score of sentiment classification using our method via different machine learning models and sentiment datasets. We compare the quality of our proposition to that of baseline models, term frequency-inverse document frequency (TF-IDF) and Doc2vec, and the results show that IWVS performs better on the F1-measure for sentiment classification. At the same time, XGBoost with IWVS features was the best model in our evaluation.Keywords
This publication has 25 references indexed in Scilit:
- Hybrid Movie Recommender System Based on Word Embeddings2022
- Discriminant document embeddings with an extreme learning machine for classifying clinical narrativesNeurocomputing, 2018
- Content Tree Word Embedding for document representationExpert Systems with Applications, 2017
- Combine HowNet lexicon to train phrase recursive autoencoder for sentence-level sentiment analysisNeurocomputing, 2017
- A survey on opinion mining and sentiment analysis: Tasks, approaches and applicationsKnowledge-Based Systems, 2015
- Political leaders and the media. Can we measure political leadership images in newspapers using computer-assisted content analysis?Quality & Quantity, 2015
- Text as Data: The Promise and Pitfalls of Automatic Content Analysis Methods for Political TextsPolitical Analysis, 2013
- Opinion Mining of Movie Review using Hybrid Method of Support Vector Machine and Particle Swarm OptimizationProcedia Engineering, 2013
- Good News or Bad News? Conducting Sentiment Analysis on Dutch Text to Distinguish Between Positive and Negative RelationsJournal of Information Technology & Politics, 2008
- Random forest classifier for remote sensing classificationInternational Journal of Remote Sensing, 2005