Self‐supervised multi‐view clustering in computer vision: A survey
Authors:
Open Access
- 2 July 2024
- journal article
- review article
- Published by Institution of Engineering and Technology (IET) in IET Computer Vision
- Vol. 18 (6) , 709-734
Abstract
In recent years, multi‐view clustering (MVC) has had significant implications in the fields of cross‐modal representation learning and data‐driven decision‐making. Its main objective is to cluster samples into distinct groups by leveraging consistency and complementary information among multiple views. However, the field of computer vision has witnessed the evolution of contrastive learning, and self‐supervised learning has made substantial research progress. Consequently, self‐supervised learning is progressively becoming dominant in MVC methods. It involves designing proxy tasks to extract supervisory information from image and video data, thereby guiding the clustering process. Despite the rapid development of self‐supervised MVC, there is currently no comprehensive survey analysing and summarising the current state of research progress. Hence, the authors aim to explore the emergence of self‐supervised MVC by discussing the reasons and advantages behind it. Additionally, the internal connections and classifications of common datasets, data issues, representation learning methods, and self‐supervised learning methods are investigated. The authors not only introduce the mechanisms for each category of methods, but also provide illustrative examples of their applications. Finally, some open problems are identified for further investigation and development.Keywords
All Related Versions
This publication has 56 references indexed in Scilit:
- Self‐supervised image clustering from multiple incomplete views via constrastive complementary generationIET Computer Vision, 2022
- Contrastive and attentive graph learning for multi-view clusteringInformation Processing & Management, 2022
- Multi-view graph embedding clustering network: Joint self-supervision and block diagonal representationNeural Networks, 2022
- Deep embedded multi-view clustering with collaborative trainingInformation Sciences, 2021
- Contrastive Multiview Coding2020
- Multi-graph fusion for multi-view spectral clusteringKnowledge-Based Systems, 2020
- Multi-view learning overview: Recent progress and new challengesInformation Fusion, 2017
- Multiview cluster ensembles for multimodal MRI segmentationInternational Journal of Imaging Systems and Technology, 2015
- Joint stage recognition and anatomical annotation of drosophila gene expression patternsBioinformatics, 2012
- Clustering Multi-represented Objects with Noise2004