Exploring performance of clustering methods on document sentiment analysis
- 10 July 2016
- journal article
- research article
- Published by SAGE Publications in Journal of Information Science
- Vol. 43 (1) , 54-74
Abstract
Clustering is a powerful unsupervised tool for sentiment analysis from text. However, the clustering results may be affected by any step of the clustering process, such as data pre-processing strategy, term weighting method in Vector Space Model and clustering algorithm. This paper presents the results of an experimental study of some common clustering techniques with respect to the task of sentiment analysis. Different from previous studies, in particular, we investigate the combination effects of these factors with a series of comprehensive experimental studies. The experimental results indicate that, first, the K-means-type clustering algorithms show clear advantages on balanced review datasets, while performing rather poorly on unbalanced datasets by considering clustering accuracy. Second, the comparatively newly designed weighting models are better than the traditional weighting models for sentiment clustering on both balanced and unbalanced datasets. Furthermore, adjective and adverb words extraction strategy can offer obvious improvements on clustering performance, while strategies of adopting stemming and stopword removal will bring negative influences on sentiment clustering. The experimental results would be valuable for both the study and usage of clustering methods in online review sentiment analysis.Keywords
This publication has 59 references indexed in Scilit:
- Text document clustering based on neighborsData & Knowledge Engineering, 2009
- Performance evaluation of density-based clustering methodsInformation Sciences, 2009
- Opinion Mining and Sentiment AnalysisFoundations and Trends® in Information Retrieval, 2008
- Stylistic text classification using functional lexical featuresJournal of the American Society for Information Science and Technology, 2007
- Normalized cuts and image segmentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Data clusteringACM Computing Surveys, 1999
- Automatic query formulations in information retrievalJournal of the American Society for Information Science, 1983
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982
- The measurement of term importance in automatic indexingJournal of the American Society for Information Science, 1981
- A STATISTICAL INTERPRETATION OF TERM SPECIFICITY AND ITS APPLICATION IN RETRIEVALJournal of Documentation, 1972