DMIB: Dual-Correlated Multivariate Information Bottleneck for Multiview Clustering
- 21 October 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Cybernetics
- Vol. 52 (6) , 4260-4274
Abstract
Multiview clustering (MVC) has recently been the focus of much attention due to its ability to partition data from multiple views via view correlations. However, most MVC methods only learn either interfeature correlations or intercluster correlations, which may lead to unsatisfactory clustering performance. To address this issue, we propose a novel dual-correlated multivariate information bottleneck (DMIB) method for MVC. DMIB is able to explore both interfeature correlations (the relationship among multiple distinct feature representations from different views) and intercluster correlations (the close agreement among clustering results obtained from individual views). For the former, we integrate both view-shared feature correlations discovered by learning a shared discriminative feature subspace and view-specific feature information to fully explore the interfeature correlation. This allows us to attain multiple reliable local clustering results of different views. Following this, we explore the intercluster correlations by learning the shared mutual information over different local clusterings for an improved global partition. By integrating both correlations, we formulate the problem as a unified information maximization function and further design a two-step method for optimization. Moreover, we theoretically prove the convergence of the proposed algorithm, and discuss the relationships between our method and several existing clustering paradigms. The experimental results on multiple datasets demonstrate the superiority of DMIB compared to several state-of-the-art clustering methods.Keywords
Funding Information
- National Natural Science Foundation of China (61772475)
- National Key Research and Development Plan “Advanced Rail Transit” (2018YFB1201403)
This publication has 65 references indexed in Scilit:
- Unsupervised video categorization based on multivariate information bottleneck methodKnowledge-Based Systems, 2015
- Multitask Spectral Clustering by Exploring Intertask CorrelationIEEE Transactions on Cybernetics, 2014
- A Multiple-Feature and Multiple-Kernel Scene Segmentation Algorithm for Humanoid RobotIEEE Transactions on Cybernetics, 2014
- Large-Margin Multi-ViewInformation BottleneckIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Multi-View Clustering via Joint Nonnegative Matrix Factorization2013
- The Multi-view Information Bottleneck Clustering2007
- Multivariate Information BottleneckNeural Computation, 2006
- Reducing the Dimensionality of Data with Neural NetworksScience, 2006
- SURF: Speeded Up Robust Features2006
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004