Scalable and Effective Deep CCA via Soft Decorrelation
Authors:
- Xiaobin ChangXCXiaobin Chang
- Tao XiangTXTao Xiang
- Timothy M. HospedalesTHTimothy M. Hospedales
- 1 June 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1488-1497
Abstract
Recently the widely used multi-view learning model, Canonical Correlation Analysis (CCA) has been generalised to the non-linear setting via deep neural networks. Existing deep CCA models typically first decorrelate the feature dimensions of each view before the different views are maximally correlated in a common latent space. This feature decorrelation is achieved by enforcing an exact decorrelation constraint; these models are thus computationally expensive due to the matrix inversion or SVD operations required for exact decorrelation at each training iteration. Furthermore, the decorrelation step is often separated from the gradient descent based optimisation, resulting in sub-optimal solutions. We propose a novel deep CCA model Soft CCA to overcome these problems. Specifically, exact decorrelation is replaced by soft decorrelation via a mini-batch based Stochastic Decorrelation Loss (SDL) to be optimised jointly with the other training objectives. Extensive experiments show that the proposed soft CCA is more effective and efficient than existing deep CCA models. In addition, our SDL loss can be applied to other deep models beyond multi-view learning, and obtains superior performance compared to existing decorrelation losses.Keywords
All Related Versions
This publication has 24 references indexed in Scilit:
- Correlational Neural NetworksNeural Computation, 2016
- Scalable Person Re-identification: A Benchmark2015
- Stochastic optimization for deep CCA via nonlinear orthogonal iterations2015
- Going deeper with convolutions2015
- Deep correlation for matching images and text2015
- Unsupervised learning of acoustic features via deep canonical correlation analysis2015
- A Multi-View Embedding Space for Modeling Internet Images, Tags, and Their SemanticsInternational Journal of Computer Vision, 2013
- Canonical Correlation Analysis: An Overview with Application to Learning MethodsNeural Computation, 2004
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- RELATIONS BETWEEN TWO SETS OF VARIATESBiometrika, 1936