Systematic Review of Clustering High-Dimensional and Large Datasets
Authors:
Open Access
- 23 January 2018
- journal article
- review article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Knowledge Discovery From Data
- Vol. 12 (2) , 1-68
Abstract
Technological advancement has enabled us to store and process huge amount of data in relatively short spans of time. The nature of data is rapidly changing, particularly its dimensionality is more commonly multi- and high-dimensional. There is an immediate need to expand our focus to include analysis of high-dimensional and large datasets. Data analysis is becoming a mammoth task, due to incremental increase in data volume and complexity in terms of heterogony of data. It is due to this dynamic computing environment that the existing techniques either need to be modified or discarded to handle new data in multiple high-dimensions. Data clustering is a tool that is used in many disciplines, including data mining, so that meaningful knowledge can be extracted from seemingly unstructured data. The aim of this article is to understand the problem of clustering and various approaches addressing this problem. This article discusses the process of clustering from both microviews (data treating) and macroviews (overall clustering process). Different distance and similarity measures, which form the cornerstone of effective data clustering, are also identified. Further, an in-depth analysis of different clustering approaches focused on data mining, dealing with large-scale datasets is given. These approaches are comprehensively compared to bring out a clear differentiation among them. This article also surveys the problem of high-dimensional data and the existing approaches, that makes it more relevant. It also explores the latest trends in cluster analysis, and the real-life applications of this concept. This survey is exhaustive as it tries to cover all the aspects of clustering in the field of data mining.Keywords
This publication has 122 references indexed in Scilit:
- Clustering with a new distance measure based on a dual-rooted treeInformation Sciences, 2013
- A survey on clustering algorithms for wireless sensor networksInternational Journal of Space-Based and Situated Computing, 2011
- Correlation clusteringACM SIGKDD Explorations Newsletter, 2009
- Modulated Modularity Clustering as an Exploratory Tool for Functional Genomic InferencePLOS Genetics, 2009
- What is the expectation maximization algorithm?Nature Biotechnology, 2008
- Biclustering algorithms for biological data analysis: a surveyIEEE/ACM Transactions on Computational Biology and Bioinformatics, 2004
- Finding generalized projected clusters in high dimensional spacesACM SIGMOD Record, 2000
- Fuzzy ART: Fast stable learning and categorization of analog patterns by an adaptive resonance systemNeural Networks, 1991
- Symbolic clustering using a new dissimilarity measurePattern Recognition, 1991
- The Application of Computers to TaxonomyMicrobiology, 1957