Style Transfer for Light Field Photography
Preprint
Abstract
As light field images continue to increase in use and application, it becomes necessary to adapt existing image processing methods to this unique form of photography. In this paper we explore methods for applying neural style transfer to light field images. Feed-forward style transfer networks provide fast, high-quality results for monocular images, but no such networks exist for full light field images. Because of the size of these images, current light field data sets are small and are insufficient for training purely feed-forward style-transfer networks from scratch. Thus, it is necessary to adapt existing monocular style transfer networks in a way that allows for the stylization of each view of the light field while maintaining visual consistencies between views. Instead, the proposed method backpropagates the loss through the network, and the process is iterated to optimize (essentially overfit) the resulting stylization for a single light field image alone. The network architecture allows for the incorporation of pre-trained fast monocular stylization networks while avoiding the need for a large light field training set.Keywords
All Related Versions
This publication has 7 references indexed in Scilit:
- Accurate Light Field Depth Estimation With Superpixel Regularization Over Partially Occluded RegionsIEEE Transactions on Image Processing, 2018
- Artistic Style Transfer for Videos and Spherical ImagesInternational Journal of Computer Vision, 2018
- Intrinsic Light Field ImagesComputer Graphics Forum, 2017
- High quality depth map estimation of object surface from light-field imagesNeurocomputing, 2017
- SVBRDF-Invariant Shape and Reflectance Estimation from Light-Field Cameras2016
- Geometrically Consistent Stereoscopic Image Editing Using Patch-Based SynthesisIEEE Transactions on Visualization and Computer Graphics, 2014
- Painterly rendering techniques: a state‐of‐the‐art review of current approachesComputer Animation and Virtual Worlds, 2012