Masked Linear Regression for Learning Local Receptive Fields for Facial Expression Synthesis
Authors:
- Nazar KhanNKNazar Khan
- Arbish AkramAAArbish Akram
- Arif MahmoodAMArif Mahmood
- Sania AshrafSASania Ashraf
- Kashif MurtazaKMKashif Murtaza
Preprint
Abstract
Compared to facial expression recognition, expression synthesis requires a very high-dimensional mapping. This problem exacerbates with increasing image sizes and limits existing expression synthesis approaches to relatively small images. We observe that facial expressions often constitute sparsely distributed and locally correlated changes from one expression to another. By exploiting this observation, the number of parameters in an expression synthesis model can be significantly reduced. Therefore, we propose a constrained version of ridge regression that exploits the local and sparse structure of facial expressions. We consider this model as masked regression for learning local receptive fields. In contrast to the existing approaches, our proposed model can be efficiently trained on larger image sizes. Experiments using three publicly available datasets demonstrate that our model is significantly better than $\ell_0, \ell_1$ and $\ell_2$-regression, SVD based approaches, and kernelized regression in terms of mean-squared-error, visual quality as well as computational and spatial complexities. The reduction in the number of parameters allows our method to generalize better even after training on smaller datasets. The proposed algorithm is also compared with state-of-the-art GANs including Pix2Pix, CycleGAN, StarGAN and GANimation. These GANs produce photo-realistic results as long as the testing and the training distributions are similar. In contrast, our results demonstrate significant generalization of the proposed algorithm over out-of-dataset human photographs, pencil sketches and even animal faces.
Keywords
All Related Versions
This publication has 18 references indexed in Scilit:
- GANimation: One-Shot Anatomically Consistent Facial AnimationInternational Journal of Computer Vision, 2019
- Discriminant Incoherent Component AnalysisIEEE Transactions on Image Processing, 2016
- Facial expression transfer method based on frequency analysisPattern Recognition, 2016
- A spatio-temporal RBM-based model for facial expression recognitionPattern Recognition, 2016
- A realistic dynamic facial expression transfer methodNeurocomputing, 2012
- Bosphorus Database for 3D Face Analysis2008
- Performance-Driven Facial Animation: Basic Research on Human Judgments of Emotional State in Facial AvatarsCyberPsychology & Behavior, 2001
- Automatic analysis of facial expressions: the state of the artIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Gradient-based learning applied to document recognitionProceedings of the IEEE, 1998
- Eigenfaces vs. Fisherfaces: recognition using class specific linear projectionIEEE Transactions on Pattern Analysis and Machine Intelligence, 1997