Influence of Word Normalization and Chi-Squared Feature Selection on Support Vector Machine (SVM) Text Classification
Authors:
- 1 September 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 229-233
Abstract
In this study, we used SVM for text classification. There is stemming or Iemmatization word normalization with the addition of Chi-squarefeature selection on the classification that we made. There are also pre-processing data being performed, namely stopwords removal and tokenize. We used BBC dataset containing 2,225 documents and 5 categories. There are 21,813. features resulting from the use of stemming and 31,007 features resulting from the use of lemmatization. Each feature represents the number of words that come out in the document. We used confusion matrix to evaluate the results of text clasification. SVM text classification performance using stemming enhanced by Chi-squared (method 1) get better results than using lemmatization enhanced by Chi-squared (method 2). The best performance was obtained using 80% feature reduction where method 1 received a precision value of 95%, a recall value of 95%, and an accuracy value of 95.05%. Method 2 only received a precision value of 93%, a recall value of 93%, and an accuracy value of 93.24% using the same amount of feature reduction.Keywords
This publication has 8 references indexed in Scilit:
- Morphology analysis for Hidden Markov Model based Indonesian part-of-speech tagger2017
- Document Classification Using Machine Learning Algorithms - A ReviewInternational Journal of Scientific Engineering and Research, 2017
- Evaluation of classification methods for Indonesian text emotion detection2016
- A New SVM Method for Short Text Classification Based on Semi-Supervised Learning2015
- KNN based Machine Learning Approach for Text and Document MiningInternational Journal of Database Theory and Application, 2014
- Data classification using Support Vector Machine integrated with scatter search method2012
- A systematic analysis of performance measures for classification tasksInformation Processing & Management, 2009
- Introduction to Information Retrieval2008