Coupled Clustering Ensemble by Exploring Data Interdependence
Authors:
Open Access
- 28 August 2018
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Knowledge Discovery From Data
- Vol. 12 (6) , 1-38
Abstract
Clustering ensembles combine multiple partitions of data into a single clustering solution. It is an effective technique for improving the quality of clustering results. Current clustering ensemble algorithms are usually built on the pairwise agreements between clusterings that focus on the similarity via consensus functions, between data objects that induce similarity measures from partitions and re-cluster objects, and between clusters that collapse groups of clusters into meta-clusters. In most of those models, there is a strong assumption on IIDness (i.e., independent and identical distribution), which states that base clusterings perform independently of one another and all objects are also independent. In the real world, however, objects are generally likely related to each other through features that are either explicit or even implicit. There is also latent but definite relationship among intermediate base clusterings because they are derived from the same set of data. All these demand a further investigation of clustering ensembles that explores the interdependence characteristics of data. To solve this problem, a new coupled clustering ensemble (CCE) framework that works on the interdependence nature of objects and intermediate base clusterings is proposed in this article. The main idea is to model the coupling relationship between objects by aggregating the similarity of base clusterings, and the interactive relationship among objects by addressing their neighborhood domains. Once these interdependence relationships are discovered, they will act as critical supplements to clustering ensembles. We verified our proposed framework by using three types of consensus function: clustering-based, object-based, and cluster-based. Substantial experiments on multiple synthetic and real-life benchmark datasets indicate thatCCEcan effectively capture the implicit interdependence relationships among base clusterings and among objects with higher clustering accuracy, stability, and robustness compared to 14 state-of-the-art techniques, supported by statistical analysis. In addition, we show that the final clustering quality is dependent on the data characteristics (e.g., quality and consistency) of base clusterings in terms of sensitivity analysis. Finally, the applications in document clustering, as well as on the datasets with much larger size and dimensionality, further demonstrate the effectiveness, efficiency, and scalability of our proposed models.Keywords
Funding Information
- Griffith University's 2018 New Researcher Grant
This publication has 35 references indexed in Scilit:
- Non-IIDness Learning in Behavioral and Social DataThe Computer Journal, 2013
- A SURVEY OF CLUSTERING ENSEMBLE ALGORITHMSInternational Journal of Pattern Recognition and Artificial Intelligence, 2011
- Democratic instance selection: A linear complexity instance selection algorithm based on classifier ensemble conceptsArtificial Intelligence, 2010
- On combining multiple clusterings: an overview and a new perspectiveApplied Intelligence, 2009
- Weighted cluster ensemblesACM Transactions on Knowledge Discovery From Data, 2009
- Clustering aggregationACM Transactions on Knowledge Discovery From Data, 2007
- Clustering by Passing Messages Between Data PointsScience, 2007
- An information-theoretic perspective of tf–idf measuresInformation Processing & Management, 2003
- Rock: A robust clustering algorithm for categorical attributesInformation Systems, 2000
- 10.1162/153244303321897735Applied Physics Letters, 2000