Style Transfer Via Image Component Analysis
Authors:
- 3 June 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Multimedia
- Vol. 15 (7) , 1594-1601
Abstract
Example-based stylization provides an easy way of making artistic effects for images and videos. However, most existing methods do not consider the content and style separately. In this paper, we propose a style transfer algorithm via a novel component analysis approach, based on various image processing techniques. First, inspired by the steps of drawing a picture, an image is decomposed into three components: draft, paint and edge, which describe the content, main style, and strengthened strokes along the boundaries. Then the style is transferred from the template image to the source image in the paint and edge components. Style transfer is formulated as a global optimization problem by using Markov random fields, and a coarse-to-fine belief propagation algorithm is used to solve the optimization problem. To combine the draft component and the obtained style information, the final artistic result can be achieved via a reconstruction step. Compared to other algorithms, our method not only synthesizes the style, but also preserves the image content well. We also extend our algorithm from single image stylization to video personalization, by maintaining the temporal coherence and identifying faces in video sequences. The results indicate that our approach performs excellently in stylization and personalization for images and videos.Keywords
This publication has 22 references indexed in Scilit:
- Automatic motion-guided video stylization and personalization2011
- Decorating Surfaces with Bidirectional Texture FunctionsIEEE Transactions on Visualization and Computer Graphics, 2005
- Efficient example-based painting and synthesis of 2D directional textureIEEE Transactions on Visualization and Computer Graphics, 2004
- Graphcut textures2003
- Face sketch synthesis and recognition2003
- Mean shift: a robust approach toward feature space analysisIEEE Transactions on Pattern Analysis and Machine Intelligence, 2002
- Stylization and abstraction of photographs2002
- Image quilting for texture synthesis and transfer2001
- Image analogies2001
- Computer-generated watercolor1997