Multiple Representations-Based Face Sketch–Photo Synthesis
- 7 September 2015
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Networks and Learning Systems
- Vol. 27 (11) , 2201-2215
Abstract
Face sketch-photo synthesis plays an important role in law enforcement and digital entertainment. Most of the existing methods only use pixel intensities as the feature. Since face images can be described using features from multiple aspects, this paper presents a novel multiple representations-based face sketch-photo-synthesis method that adaptively combines multiple representations to represent an image patch. In particular, it combines multiple features from face images processed using multiple filters and deploys Markov networks to exploit the interacting relationships between the neighboring image patches. The proposed framework could be solved using an alternating optimization strategy and it normally converges in only five outer iterations in the experiments. Our experimental results on the Chinese University of Hong Kong (CUHK) face sketch database, celebrity photos, CUHK Face Sketch FERET Database, IIIT-D Viewed Sketch Database, and forensic sketches demonstrate the effectiveness of our method for face sketch-photo synthesis. In addition, cross-database and database-dependent style-synthesis evaluations demonstrate the generalizability of this novel method and suggest promising solutions for face identification in forensic science.Keywords
Funding Information
- National Basic Research Program of China (973 Program) (2012CB316400)
- National Natural Science Foundation of China (61125204, 61172146, 61432014, 61501339)
- Fundamental Research Funds for the Central Universities (JB149901, XJS15049)
- Program for Changjiang Scholars and Innovative Research Team in University of China (IRT13088)
- Shaanxi Innovative Research Team for Key Science and Technology (2012KCT-02)
- Key Research Program of the Chinese Academy of Sciences (KGZDEW-T03)
- Australian Research Council Projects (FT-130101457, DP-140102164, LP-140100569)
This publication has 50 references indexed in Scilit:
- Face sketch-photo synthesis based on support vector regression2011
- Coupled information-theoretic encoding for face photo-sketch recognition2011
- A new approach for face recognition by sketches in photosSignal Processing, 2009
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Face Sketch Synthesis Algorithm Based on E-HMM and Selective EnsembleIEEE Transactions on Circuits and Systems for Video Technology, 2008
- Using Biologically Inspired Features for Face ProcessingInternational Journal of Computer Vision, 2007
- Histograms of Oriented Gradients for Human Detection2005
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Multiresolution gray-scale and rotation invariant texture classification with local binary patternsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989