An Efficient Document Clustering Approach for Devising Semantic Clusters
- 11 February 2023
- journal article
- research article
- Published by Taylor & Francis in Cybernetics and Systems
- Vol. 56 (5) , 526-543
Abstract
The rise of superfluous information day by day has made the clustering of information into meaningful sets challenging. We propose an efficient approach for obtaining semantic clusters from a huge volume of documents. The preprocessing based on the lexical ontological information from WordNet helps in reducing the feature space and eliminating synonymy problems among the features. A considerable decrease in computational time is achieved by means of an enhanced k-means clustering algorithm. This algorithm computes the starting centroids using a sorting technique based on Red-Black Tree, thus ensuring efficiency and meaningful clusters. Memoization techniques are utilized in the subsequent stages, to avoid redundant computations. Results indicate that our method produces more meaningful clusters than those employing word embedding models like Word2Vec, FastText, and BERT for feature extraction. The experimental results on the MiniNewsGroup, 20NewsGroup Large dataset, and Reuters-21578 dataset show remarkable achievement in clustering outcomes in terms of purity and execution time. Results on the enormous data collection 20NewsGroup Large dataset show a better NMI (Normalized Mutual Information) score compared to the existing methods.Keywords
This publication has 29 references indexed in Scilit:
- Learning From Hidden Traits: Joint Factor Analysis and Latent ClusteringIEEE Transactions on Signal Processing, 2016
- Finding Similar Documents Using Different Clustering TechniquesProcedia Computer Science, 2016
- Ontology-Based Mapping for Automated Document ManagementACM Transactions on Management Information Systems, 2015
- A semantic approach for text clustering using WordNet and lexical chainsExpert Systems with Applications, 2015
- Semantic data mining: A survey of ontology-based approaches2015
- A Heuristic k-Means Algorithm with Better Accuracy and Efficiency for Clustering Health Informatics DataJournal of Medical Imaging and Health Informatics, 2011
- On ontology-driven document clustering using core semantic featuresKnowledge and Information Systems, 2011
- Knowledge-based vector space model for text clusteringKnowledge and Information Systems, 2009
- Exploiting noun phrases and semantic relationships for text document clusteringInformation Sciences, 2009
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982