Self-Correcting Clustering
- 26 December 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Knowledge and Data Engineering
- Vol. 37 (3) , 1439-1454
Abstract
The incorporation of target distribution significantly enhances the success of deep clustering. However, most of the related deep clustering methods suffer from two drawbacks: (1) manually-designed target distribution functions with uncertain performance and (2) cluster misassignment accumulation. To address these issues, a Self - C orrecting C lustering (Self-CC) framework is proposed. In Self-CC, a robust target distribution solver (RTDS) is designed to automatically predict the target distribution and alleviate the adverse influence of misassignments. Specifically, RTDS divides the high confidence samples selected according to the cluster assignments predicted by a clustering module into labeled samples with correct pseudo labels and unlabeled samples of possible misassignments by modeling its training loss distribution. With the divided data, RTDS can be trained in a semi-supervised way. The critical hyperparameter which controls the semi-supervised training process can be set adaptively by estimating the distribution property of misassignments in the pseudo-label space with the support of a theoretical analysis. The target distribution can be predicted by the well-trained RTDS automatically, optimizing the clustering module and correcting misassignments in the cluster assignments. The clustering module and RTDS mutually promote each other forming a positive feedback loop. Extensive experiments on four benchmark datasets demonstrate the effectiveness of the proposed Self-CC.Keywords
Funding Information
- National Natural Science Foundation of China (U22B2036, 62476213)
This publication has 44 references indexed in Scilit:
- Deep Online Probability Aggregation Clustering2024
- Imbalance-Aware Discriminative Clustering for Unsupervised Semantic SegmentationInternational Journal of Computer Vision, 2024
- Strongly augmented contrastive clusteringPattern Recognition, 2023
- Data clustering: application and trendsArtificial Intelligence Review, 2022
- ScanMix: Learning from Severe Label Noise via Semantic Clustering and Semi-Supervised LearningPattern Recognition, 2022
- Enforced block diagonal subspace clustering with closed form solutionPattern Recognition, 2022
- Improved deep convolutional embedded clustering with re-selectable sample trainingPattern Recognition, 2022
- SCAN: Learning to Classify Images Without Labels2020
- Real-time object detection and localization with SIFT-based clusteringImage and Vision Computing, 2012
- Robust kernel IsomapPattern Recognition, 2007