Image Purification through Controllable Neural Style Transfer
Authors:
- 1 October 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 466-471
Abstract
Recently, progress in learning-by-synthesis proposed training models on synthetic images that can effectively reduce the cost of human and material resources. However, learning from synthetic images still cannot achieve the desired performance due to the different distribution of synthetic images compared to naturalistic images. Naturalistic images are composed of multiform light distribution, which is a characteristic of the outdoor scene. In an attempt to address this issue, previous methods learn a model to improve the realism of synthetic images. Differently from previous methods, this paper takes the first step towards purifying the naturalistic image to weaken the influence of light and convert the distribution of outdoor naturalistic image through a style transfer task to that of indoor synthetic image. This paper proposes therefore, a controlled neural style transfer network to preserve image structure, accelerate model convergence rate and adapt to multi-scale images. A mixed research approach (qualitative and quantitative) was adopted for the experiments carried out to demonstrate the possibility of purifying naturalistic images of complex distribution. Qualitatively, it compares the proposed method with baseline methods across several indoor and outdoor scenes of the LPW dataset. While quantitatively it evaluates the purified images by training models for gaze estimation on cross-dataset. Results show a significant improvement over using raw naturalistic images and when compared with the baseline methods.Keywords
This publication has 12 references indexed in Scilit:
- Deep Photo Style Transfer2017
- Image Style Transfer Using Convolutional Neural Networks2016
- Learning an appearance-based gaze estimator from one million synthesised images2016
- Rendering of Eyes for Eye-Shape Registration and Gaze Estimation2015
- Gaze Estimation From Eye Appearance: A Head Pose-Free Method via Eye Image SynthesisIEEE Transactions on Image Processing, 2015
- Appearance-based gaze estimation in the wild2015
- Hierarchical gaze estimation based on adaptive feature learning2014
- Learning-by-Synthesis for Appearance-Based 3D Gaze Estimation2014
- Rendering synthetic ground truth images for eye tracker evaluation2014
- Color transfer between imagesIEEE Computer Graphics and Applications, 2001