Comprehensive Study on Lexicon-based Ensemble Classification Sentiment Analysis
Open Access
Abstract
We propose a novel method for counting sentiment orientation that outperforms supervised learning approaches in time and memory complexity and is not statistically significantly different from them in accuracy. Our method consists of a novel approach to generating unigram, bigram and trigram lexicons. The proposed method, called frequentiment, is based on calculating the frequency of features (words) in the document and averaging their impact on the sentiment score as opposed to documents that do not contain these features. Afterwards, we use ensemble classification to improve the overall accuracy of the method. What is important is that the frequentiment-based lexicons with sentiment threshold selection outperform other popular lexicons and some supervised learners, while being 3–5 times faster than the supervised approach. We compare 37 methods (lexicons, ensembles with lexicon’s predictions as input and supervised learners) applied to 10 Amazon review data sets and provide the first statistical comparison of the sentiment annotation methods that include ensemble approaches. It is one of the most comprehensive comparisons of domain sentiment analysis in the literature.Keywords
Funding Information
- The European Commission under the 7th Framework Programme (316097)
- Narodowe Centrum Nauki (DEC-2013/09/B/ST6/02317)
This publication has 26 references indexed in Scilit:
- Sentiment analysis algorithms and applications: A surveyAin Shams Engineering Journal, 2014
- Twitter brand sentiment analysis: A hybrid system using n-gram analysis and dynamic artificial neural networkExpert Systems with Applications, 2013
- CROWDSOURCING A WORD–EMOTION ASSOCIATION LEXICONComputational Intelligence, 2012
- Twitter mood predicts the stock marketJournal of Computational Science, 2011
- Predicting consumer sentiments from online textDecision Support Systems, 2011
- Sentiment classification of online reviews to travel destinations by supervised machine learning approachesExpert Systems with Applications, 2009
- Opinion Mining and Sentiment AnalysisFoundations and Trends® in Information Retrieval, 2008
- Ensemble based systems in decision makingIEEE Circuits and Systems Magazine, 2006
- Measuring praise and criticismACM Transactions on Information Systems, 2003
- Bagging predictorsMachine Learning, 1996