An image inpainting method based on generative adversarial networks inversion and autoencoder
Authors:
Open Access
- 2 December 2023
- journal article
- research article
- Published by Institution of Engineering and Technology (IET) in IET Image Processing
- Vol. 18 (4) , 1042-1052
Abstract
Image inpainting aims to repair the damaged region according to the known content in the damaged image. Recently, image inpainting methods have poor effects on high‐resolution damaged images, and the research on the inpainting of large‐area damaged images is limited. Therefore, this paper proposes an image inpainting method based on Generative Adversarial Networks (GAN) inversion and autoencoder. This work consists of two phases: first, the authors design an autoencoder‐based GAN, which learns the mapping from noise to low‐dimensional feature maps by training a generator, and then converts the generated feature maps into high‐resolution images. Thus, the difficulty of learning the mapping relationship is reduced. Second, the authors adopt the learning‐based GAN inversion to infer the closest latent code. The trained GAN is then used to reconstruct the complete image. Finally, the authors compare their method with other classical methods on the CelebAMask‐HQ, Flickr‐Faces‐HQ, and ImageNet datasets. According to the quantitative comparison, when the mask range is large, in other words, when the image has a large area of damage, the authors’ method is superior to the comparison methods. According to the qualitative comparison, the structure of the high‐resolution image inpainted by the authors’ method is more reasonable and the texture details are more realistic.Keywords
Funding Information
- National Natural Science Foundation of China (61972133)
This publication has 28 references indexed in Scilit:
- Image Inpainting for Irregular Holes Using Partial Convolutions2018
- Generative Image Inpainting with Contextual Attention2018
- Globally and locally consistent image completionACM Transactions on Graphics, 2017
- Semantic Image Inpainting with Deep Generative Models2017
- Context Encoders: Feature Learning by Inpainting2016
- Deep Learning Face Attributes in the Wild2015
- Image Inpainting by Patch Propagation Using Patch SparsityIEEE Transactions on Image Processing, 2010
- Region Filling and Object Removal by Exemplar-Based Image InpaintingIEEE Transactions on Image Processing, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Image inpainting2000