Low-Rank Matrix Completion by Riemannian Optimization
Author:
- Bart VandereyckenBVBart Vandereycken
Top Cited Papers
- 1 January 2013
- journal article
- Published by Society for Industrial & Applied Mathematics (SIAM) in SIAM Journal on Optimization
- Vol. 23 (2) , 1214-1236
Abstract
The matrix completion problem consists of finding or approximating a low-rank matrix based on a few samples of this matrix. We propose a new algorithm for matrix completion that minimizes the least-square distance on the sampling set over the Riemannian manifold of fixed-rank matrices. The algorithm is an adaptation of classical nonlinear conjugate gradients, developed within the framework of retraction-based optimization on manifolds. We describe all the necessary objects from differential geometry necessary to perform optimization over this low-rank matrix manifold, seen as a submanifold embedded in the space of matrices. In particular, we describe how metric projection can be used as retraction and how vector transport lets us obtain the conjugate search directions. Finally, we prove convergence of a regularized version of our algorithm under the assumption that the restricted isometry property holds for incoherent matrices throughout the iterations. The numerical experiments indicate that our approach...Keywords
This publication has 31 references indexed in Scilit:
- Iterative methods for low rank approximation of graph similarity matricesLinear Algebra and its Applications, 2013
- Projection-like Retractions on Matrix ManifoldsSIAM Journal on Optimization, 2012
- The Power of Convex Relaxation: Near-Optimal Matrix CompletionIEEE Transactions on Information Theory, 2010
- Matrix Completion With NoiseProceedings of the IEEE, 2010
- A Singular Value Thresholding Algorithm for Matrix CompletionSIAM Journal on Optimization, 2010
- Exact Matrix Completion via Convex OptimizationFoundations of Computational Mathematics, 2009
- Trust-Region Methods on Riemannian ManifoldsFoundations of Computational Mathematics, 2006
- Local Minima and Convergence in Low-Rank Semidefinite ProgrammingMathematical Programming, 2004
- A nonlinear programming algorithm for solving semidefinite programs via low-rank factorizationMathematical Programming, 2003
- Newton's method on Riemannian manifolds and a geometric model for the human spineIMA Journal of Numerical Analysis, 2002