Face Recognition Using Sparse Approximated Nearest Points between Image Sets
- 3 January 2012
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Pattern Analysis and Machine Intelligence
- Vol. 34 (10) , 1992-2004
Abstract
We propose an efficient and robust solution for image set classification. A joint representation of an image set is proposed which includes the image samples of the set and their affine hull model. The model accounts for unseen appearances in the form of affine combinations of sample images. To calculate the between-set distance, we introduce the Sparse Approximated Nearest Point (SANP). SANPs are the nearest points of two image sets such that each point can be sparsely approximated by the image samples of its respective set. This novel sparse formulation enforces sparsity on the sample coefficients and jointly optimizes the nearest points as well as their sparse approximations. Unlike standard sparse coding, the data to be sparsely approximated are not fixed. A convex formulation is proposed to find the optimal SANPs between two sets and the accelerated proximal gradient method is adapted to efficiently solve this optimization. We also derive the kernel extension of the SANP and propose an algorithm for dynamically tuning the RBF kernel parameter while matching each pair of image sets. Comprehensive experiments on the UCSD/Honda, CMU MoBo, and YouTube Celebrities face datasets show that our method consistently outperforms the state of the art.Keywords
This publication has 41 references indexed in Scilit:
- Kernel Grassmannian distances and discriminant analysis for face recognition from image setsPattern Recognition Letters, 2009
- A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse ProblemsSIAM Journal on Imaging Sciences, 2009
- A pose-wise linear illumination manifold model for face recognition using videoComputer Vision and Image Understanding, 2009
- Boosted manifold principal angles for image set-based recognitionPattern Recognition, 2007
- Incremental Learning for Robust Visual TrackingInternational Journal of Computer Vision, 2007
- Robust Real-Time Face DetectionInternational Journal of Computer Vision, 2004
- Automatic classification of single facial imagesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1999
- Nonlinear Component Analysis as a Kernel Eigenvalue ProblemNeural Computation, 1998
- Eigenfaces vs. Fisherfaces: recognition using class specific linear projectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997
- Relations Between Two Sets of VariatesBiometrika, 1936