Cross-Domain Correspondence Learning for Exemplar-Based Image Translation
Authors:
Top Cited Papers
- 1 June 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 5142-5152
Abstract
We present a general framework for exemplar-based image translation, which synthesizes a photo-realistic image from the input in a distinct domain (e.g., semantic segmentation mask, or edge map, or pose keypoints), given an exemplar image. The output has the style (e.g., color, texture) in consistency with the semantically corresponding objects in the exemplar. We propose to jointly learn the cross-domain correspondence and the image translation, where both tasks facilitate each other and thus can be learned with weak supervision. The images from distinct domains are first aligned to an intermediate domain where dense correspondence is established. Then, the network synthesizes images based on the appearance of semantically corresponding patches in the exemplar. We demonstrate the effectiveness of our approach in several image translation tasks. Our method is superior to state-of-the-art methods in terms of image quality significantly, with the image style faithful to the exemplar with semantic consistency. Moreover, we show the utility of our method for several applications.Keywords
All Related Versions
This publication has 26 references indexed in Scilit:
- Proposal Flow: Semantic Correspondences from Object ProposalsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- FCSS: Fully Convolutional Self-Similarity for Dense Semantic Correspondence2017
- Scene Parsing through ADE20K Dataset2017
- Image-to-Image Translation with Conditional Adversarial Networks2017
- Learning Dense Correspondence via 3D-Guided Cycle Consistency2016
- DeepFashion: Powering Robust Clothes Recognition and Retrieval with Rich Annotations2016
- Deep Learning Face Attributes in the Wild2015
- DAISY: An Efficient Dense Descriptor Applied to Wide-Baseline StereoIEEE Transactions on Pattern Analysis and Machine Intelligence, 2009
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Image analogies2001