Influence of Pre-Processing Strategies on the Performance of ML Classifiers Exploiting TF-IDF and BOW Features
Authors:
- 18 June 2020
- journal article
- research article
- Published by Ediciones Universidad de Salamanca in ADCAIJ: Advances in Distributed Computing and Artificial Intelligence Journal
- Vol. 9 (2) , 49-68
Abstract
Data analytics and its associated applications have recently become impor-tant fields of study. The subject of concern for researchers now-a-days is a massive amount of data produced every minute and second as people con-stantly sharing thoughts, opinions about things that are associated with them. Social media info, however, is still unstructured, disseminated and hard to handle and need to be developed a strong foundation so that they can be utilized as valuable information on a particular topic. Processing such unstructured data in this area in terms of noise, co-relevance, emoticons, folksonomies and slangs is really quite challenging and therefore requires proper data pre-processing before getting the right sentiments. The dataset is extracted from Kaggle and Twitter, pre-processing performed using NLTK and Scikit-learn and features selection and extraction is done for Bag of Words (BOW), Term Frequency (TF) and Inverse Document Frequency (IDF) scheme. For polarity identification, we evaluated five different Machine Learning (ML) algorithms viz Multinomial Naive Bayes (MNB), Logistic Regression (LR), Decision Trees (DT), XGBoost (XGB) and Support Vector Machines (SVM). We have performed a comparative analysis of the success for these algorithms in order to decide which algorithm works best for the given data-set in terms of recall, accuracy, F1-score and precision. We assess the effects of various pre-processing techniques on two datasets; one with domain and other not. It is demonstrated that SVM classifier outperformed the other classifiers with superior evaluations of 73.12% and 94.91% for accuracy and precision respectively. It is also highlighted in this research that the selection and representation of features along with various pre-processing techniques have a positive impact on the performance of the classification. The ultimate outcome indicates an improvement in sentiment classification and we noted that pre-processing approaches obviously suggest an improvement in the efficiency of the classifiers.Keywords
This publication has 35 references indexed in Scilit:
- Term weighting scheme for short-text classification: Twitter corpusesNeural Computing and Applications, 2018
- The TF-IDF measure and analysis of links between words within N-grams in the formation of knowledge units for open testsPattern Recognition and Image Analysis, 2017
- A Comparison of Pre-processing Techniques for Twitter Sentiment Analysis2017
- Comparison of Classification Techniques for Feature Oriented Sentiment Analysis of Product Review Data2017
- Bag of works retrieval: TF*IDF weighting of works co-cited with a seedInternational Journal on Digital Libraries, 2017
- The effect of preprocessing techniques on Twitter sentiment analysis2016
- Optimized TF-IDF Algorithm with the Adaptive Weight of Position of Word2016
- Role of Text Pre-processing in Twitter Sentiment AnalysisProcedia Computer Science, 2016
- Harvesting Opinions and Emotions from Social Media Textual ResourcesIEEE Internet Computing, 2015
- The Role of Pre-processing in Twitter Sentiment Analysis2014