Multiple Representations-Based Face Sketch–Photo Synthesis

Authors:

Abstract
Face sketch-photo synthesis plays an important role in law enforcement and digital entertainment. Most of the existing methods only use pixel intensities as the feature. Since face images can be described using features from multiple aspects, this paper presents a novel multiple representations-based face sketch-photo-synthesis method that adaptively combines multiple representations to represent an image patch. In particular, it combines multiple features from face images processed using multiple filters and deploys Markov networks to exploit the interacting relationships between the neighboring image patches. The proposed framework could be solved using an alternating optimization strategy and it normally converges in only five outer iterations in the experiments. Our experimental results on the Chinese University of Hong Kong (CUHK) face sketch database, celebrity photos, CUHK Face Sketch FERET Database, IIIT-D Viewed Sketch Database, and forensic sketches demonstrate the effectiveness of our method for face sketch-photo synthesis. In addition, cross-database and database-dependent style-synthesis evaluations demonstrate the generalizability of this novel method and suggest promising solutions for face identification in forensic science.
Funding Information
  • National Basic Research Program of China (973 Program) (2012CB316400)
  • National Natural Science Foundation of China (61125204, 61172146, 61432014, 61501339)
  • Fundamental Research Funds for the Central Universities (JB149901, XJS15049)
  • Program for Changjiang Scholars and Innovative Research Team in University of China (IRT13088)
  • Shaanxi Innovative Research Team for Key Science and Technology (2012KCT-02)
  • Key Research Program of the Chinese Academy of Sciences (KGZDEW-T03)
  • Australian Research Council Projects (FT-130101457, DP-140102164, LP-140100569)

This publication has 50 references indexed in Scilit: