Noise Robust Face Hallucination via Locality-Constrained Representation
Authors:
- 11 March 2014
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 16 (5) , 1268-1281
Abstract
Recently, position-patch based approaches have been proposed to replace the probabilistic graph-based or manifold learning-based models for face hallucination. In order to obtain the optimal weights of face hallucination, these approaches represent one image patch through other patches at the same position of training faces by employing least square estimation or sparse coding. However, they cannot provide unbiased approximations or satisfy rational priors, thus the obtained representation is not satisfactory. In this paper, we propose a simpler yet more effective scheme called Locality-constrained Representation (LcR). Compared with Least Square Representation (LSR) and Sparse Representation (SR), our scheme incorporates a locality constraint into the least square inversion problem to maintain locality and sparsity simultaneously. Our scheme is capable of capturing the non-linear manifold structure of image patch samples while exploiting the sparse property of the redundant data representation. Moreover, when the locality constraint is satisfied, face hallucination is robust to noise, a property that is desirable for video surveillance applications. A statistical analysis of the properties of LcR is given together with experimental results on some public face databases and surveillance images to show the superiority of our proposed scheme over state-of-the-art face hallucination approaches.Keywords
Funding Information
- Major National Science and Technology ((2010ZX03004-003-03))
- National Key Technologies R and D Program ((2013AA014602))
- National Natural Science Foundation of China (61231015, 61070080, 61003184, 61172173, 61303114, 61170023)
This publication has 28 references indexed in Scilit:
- Structured Face Hallucination2013
- Hallucinating face by position-patchPattern Recognition, 2010
- From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and ImagesSIAM Review, 2009
- Face Hallucination: Theory and PracticeInternational Journal of Computer Vision, 2007
- For most large underdetermined systems of linear equations the minimal 𝓁1‐norm solution is also the sparsest solutionCommunications on Pure and Applied Mathematics, 2006
- Hallucinating Face by EigentransformationIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2005
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Limits on super-resolution and how to break themIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Nonlinear Dimensionality Reduction by Locally Linear EmbeddingScience, 2000
- Neural network-based face detectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1998