VariGAN: Enhancing Image Style Transfer via UNet Generator, Depthwise Discriminator, and LPIPS Loss in Adversarial Learning Framework
Open Access
Abstract
Image style transfer is a challenging task that has gained significant attention in recent years due to its growing complexity. Training is typically performed using paradigms offered by GAN-based image style transfer networks. Cycle-based training methods provide an approach for handling unpaired data. Nevertheless, achieving high transfer quality remains a challenge with these methods due to the simplicity of the employed network. The purpose of this research is to present VariGAN, a novel approach that incorporates three additional strategies to optimize GAN-based image style transfer: (1) Improving the quality of transferred images by utilizing an effective UNet generator network in conjunction with a context-related feature extraction module. (2) Optimizing the training process while reducing dependency on the generator through the use of a depthwise discriminator. (3) Introducing LPIPS loss to further refine the loss function and enhance the overall generation quality of the framework. Through a series of experiments, we demonstrate that the VariGAN backbone exhibits superior performance across diverse content and style domains. VariGAN improved class IoU by and participant identification by compared to CycleGAN.
Keywords
Funding Information
- Key Project of China Railway Group (M23D00101, W21L00390, 0606009801)
- Beijing Jiaotong University (M23D00101, W21L00390, 0606009801)
- Beijing Jiaotong University (M23D00101, W21L00390, 0606009801)
This publication has 51 references indexed in Scilit:
- EF-VPT-Net: Enhanced Feature-Based Vision Patch Transformer Network for Accurate Brain Tumor Segmentation in Magnetic Resonance ImagingIEEE Journal of Biomedical and Health Informatics, 2025
- FF-UNET: An Enhanced Framework for Improved Segmentation of Brain Tumors in MRI Images2024
- Automatic classification of asphalt pavement cracks using a novel integrated generative adversarial networks and improved VGG modelEngineering Structures, 2023
- Sharp U-Net: Depthwise convolutional network for biomedical image segmentationComputers in Biology and Medicine, 2021
- CNN-based encoder-decoder networks for salient object detection: A comprehensive review and recent advancesInformation Sciences, 2021
- GAN Compression: Efficient Architectures for Interactive Conditional GANs2020
- MultiResUNet : Rethinking the U-Net architecture for multimodal biomedical image segmentationNeural Networks, 2020
- Fast R-CNN2015
- Real Time Operation of Smart Grids via FCN Networks and Optimal Power FlowIEEE Transactions on Industrial Informatics, 2012
- Blind/Referenceless Image Spatial Quality Evaluator2011