Style Transfer Via Texture Synthesis
Authors:
Open Access
- 8 March 2017
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Image Processing
- Vol. 26 (5) , 2338-2351
Abstract
Style transfer is a process of migrating a style from a given image to the content of another, synthesizing a new image, which is an artistic mixture of the two. Recent work on this problem adopting convolutional neural-networks (CNN) ignited a renewed interest in this field, due to the very impressive results obtained. There exists an alternative path toward handling the style transfer task, via the generalization of texture synthesis algorithms. This approach has been proposed over the years, but its results are typically less impressive compared with the CNN ones. In this paper, we propose a novel style transfer algorithm that extends the texture synthesis work of Kwatra et al. (2005), while aiming to get stylized images that are closer in quality to the CNN ones. We modify Kwatra's algorithm in several key ways in order to achieve the desired transfer, with emphasis on a consistent way for keeping the content intact in selected regions, while producing hallucinated and rich style in others. The results obtained are visually pleasing and diverse, shown to be competitive with the recent CNN style transfer algorithms. The proposed algorithm is fast and flexible, being able to process any pair of content + style images.Keywords
All Related Versions
This publication has 35 references indexed in Scilit:
- Domain transform for edge-aware image and video processingACM Transactions on Graphics, 2011
- PatchMatchACM Transactions on Graphics, 2009
- Appearance-space texture synthesisACM Transactions on Graphics, 2006
- Texture optimization for example-based synthesisACM Transactions on Graphics, 2005
- Parallel controllable texture synthesisACM Transactions on Graphics, 2005
- "GrabCut"ACM Transactions on Graphics, 2004
- Example-based super-resolutionIEEE Computer Graphics and Applications, 2002
- Color transfer between imagesIEEE Computer Graphics and Applications, 2001
- The expectation-maximization algorithmIEEE Signal Processing Magazine, 1996
- Robust Regression Computation Using Iteratively Reweighted Least SquaresSIAM Journal on Matrix Analysis and Applications, 1990