The effect of preprocessing techniques on Twitter sentiment analysis
Authors:
- 1 July 2016
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
As Twitter offers a fertile ground for expressing different thoughts and opinions, it can be seen as a valuable tool for sentiment analysis. Furthermore, properly identified reviews present a baseline of information as an input to different systems, such as e-learning systems, decision support systems etc. However, the data preprocessing is a crucial step in sentiment analysis, since selecting the appropriate preprocessing methods, the correctly classified instances can be increased. In view of the above, this research paper explains the necessary information to get preprocess the reviews in order to find sentiment and make analysis whether it is positive or negative. Extended comparison of sentiment polarity classification methods for Twitter text and the role of text preprocessing in sentiment analysis are discussed in depth. In the set of tests, possible combinations of methods and report on their efficiency were included, conducting experiments using manually annotated Twitter datasets. Finally, it is proved that feature selection and representation can affect the classification performance positively.Keywords
This publication has 10 references indexed in Scilit:
- A polarity analysis framework for Twitter messagesApplied Mathematics and Computation, 2015
- Comparative analysis of algorithms for student characteristics classification using a methodological framework2015
- Stream-based active learning for sentiment analysis in the financial domainInformation Sciences, 2014
- PoliTwi: Early detection of emerging political topics on twitter and the impact on concept-level sentiment analysisKnowledge-Based Systems, 2014
- Comparing Methods for Twitter Sentiment Analysis2014
- TOM: Twitter opinion mining framework using hybrid classification schemeDecision Support Systems, 2014
- The Role of Text Pre-processing in Sentiment AnalysisProcedia Computer Science, 2013
- Supervised Opinion Mining of Social Network Data Using a Bag-of-Words Approach on the Cloud2012
- Tweet the debates2009
- Top 10 algorithms in data miningKnowledge and Information Systems, 2007