Simultaneous Tensor Decomposition and Completion Using Factor Priors
Authors:
- 28 August 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 36 (3) , 577-591
Abstract
The success of research on matrix completion is evident in a variety of real-world applications. Tensor completion, which is a high-order extension of matrix completion, has also generated a great deal of research interest in recent years. Given a tensor with incomplete entries, existing methods use either factorization or completion schemes to recover the missing parts. However, as the number of missing entries increases, factorization schemes may overfit the model because of incorrectly predefined ranks, while completion schemes may fail to interpret the model factors. In this paper, we introduce a novel concept: complete the missing entries and simultaneously capture the underlying model structure. To this end, we propose a method called simultaneous tensor decomposition and completion (STDC) that combines a rank minimization technique with Tucker model decomposition. Moreover, as the model structure is implicitly included in the Tucker model, we use factor priors, which are usually known a priori in real-world tensor objects, to characterize the underlying joint-manifold drawn from the model factors. By exploiting this auxiliary information, our method leverages two classic schemes and accurately estimates the model factors and missing entries. We conducted experiments to empirically verify the convergence of our algorithm on synthetic data and evaluate its effectiveness on various kinds of real-world data. The results demonstrate the efficacy of the proposed method and its potential usage in tensor-based applications. It also outperforms state-of-the-art methods on multilinear model analysis and visual data completion tasks.Keywords
This publication has 39 references indexed in Scilit:
- Robust Recovery of Subspace Structures by Low-Rank RepresentationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2012
- Robust Alternative Minimization for Matrix CompletionIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2012
- Bilinear Modeling via Augmented Lagrange Multipliers (BALM)IEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Three-Dimensional Motion Estimation via Matrix CompletionIEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2011
- Saliency Detection by Multitask Sparsity PursuitIEEE Transactions on Image Processing, 2011
- Semi-supervised Classification via Low Rank Graph2011
- Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm MinimizationSIAM Review, 2010
- A Singular Value Thresholding Algorithm for Matrix CompletionSIAM Journal on Optimization, 2010
- Fixed point and Bregman iterative methods for matrix rank minimizationMathematical Programming, 2009
- Learning the parts of objects by non-negative matrix factorizationNature, 1999