Performance Analysis of Cycle GAN in Photo to Portrait Transfiguration Using Deep Learning Optimizers
Open Access
- 28 November 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 136541-136551
Abstract
In the realm of computer vision, image transformations play a pivotal role across various domains such as healthcare, image enhancement, artist painting identification, genome sequencing, and more. While supervised learning demands a substantial volume of annotated images for training models, Cycle-GAN emerges as a potent solution for training models with fewer paired sources and target images in an unsupervised manner. This study introduces a novel system aimed at generating Monet-style paintings from realistic images, leveraging the Cycle-GAN methodology. Given the scarcity of Monet paintings, our system employs a combination of generator and discriminator neural networks to produce new Monet-style artworks. The model is trained using Cycle-GAN in conjunction with deep learning optimizers like RMSprop, ADAM, and SGD. The training dataset, Monet2Photo, comprises two distinct image categories: Monet paintings (300 samples) and natural photographs (7028 samples). The Monet-style images are utilized for training the model, while the raw photo images serve as the test set. Notably, the proposed model exhibits commendable performance, particularly when utilizing the SGD optimizer, as evidenced by favorable outcomes in terms of generator and discriminator losses.Keywords
Funding Information
- King Saud University, Riyadh, Saudi Arabia (RSPD2023R1060)
This publication has 29 references indexed in Scilit:
- SPA-GAN: Spatial Attention GAN for Image-to-Image TranslationIEEE Transactions on Multimedia, 2020
- Unsupervised data to content transformation with histogram-matching cycle-consistent generative adversarial networksNature Machine Intelligence, 2019
- Multiple Cycle-in-Cycle Generative Adversarial Networks for Unsupervised Image Super-ResolutionIEEE Transactions on Image Processing, 2019
- Predicting Future Frames Using Retrospective Cycle GAN2019
- Mapping Winter Crops in China with Multi-Source Satellite Imagery and Phenology-Based AlgorithmRemote Sensing, 2019
- Rhythm-Flexible Voice Conversion Without Parallel Data Using Cycle-GAN Over Phoneme Posteriorgram Sequences2018
- Attribute-Guided Face Generation Using Conditional CycleGAN2018
- Distribution Matching Losses Can Hallucinate Features in Medical Image Translation2018
- CycleGAN-VC: Non-parallel Voice Conversion Using Cycle-Consistent Adversarial Networks2018
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017