Double Nuclear Norm-Based Matrix Decomposition for Occluded Image Recovery and Background Modeling

Authors:

Abstract
Robust principal component analysis (RPCA) is a new emerging method for exact recovery of corrupted low-rank matrices. It assumes that the real data matrix has low rank and the error matrix is sparse. This paper presents a method called double nuclear norm-based matrix decomposition (DNMD) for dealing with the image data corrupted by continuous occlusion. The method uses a unified low-rank assumption to characterize the real image data and continuous occlusion. Specifically, we assume all image vectors form a low-rank matrix, and each occlusion-induced error image is a low-rank matrix as well. Compared with RPCA, the low-rank assumption of DNMD is more intuitive for describing occlusion. Moreover, DNMD is solved by alternating direction method of multipliers. Our algorithm involves only one operator: the singular value shrinkage operator. DNMD, as a transductive method, is further extended into inductive DNMD (IDNMD). Both DNMD and IDNMD use nuclear norm for measuring the continuous occlusion-induced error, while many previous methods use L 1 , L 2 , or other M-estimators. Extensive experiments on removing occlusion from face images and background modeling from surveillance videos demonstrate the effectiveness of the proposed methods.
Funding Information
  • National Science Fund for Distinguished Young Scholars (61125305, 91420201, 61472187, 61233011, 61373063)
  • Key Project of Chinese Ministry of Education (313030)
  • 973 Program (2014CB349303)
  • Fundamental Research Funds for the Central Universities (30920140121005)
  • Program for Changjiang Scholars and Innovative Research Team in University

This publication has 20 references indexed in Scilit: