Patch-Attention GAN: Image Translation using BiFormer and Attention Framework
Authors:
- 19 April 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
Image-to-image translation has long been recognized as a crucial undertaking within the field of computer vision, owing to its broad applications in domain adaption. Existing methods differ in Generative Adversarial Network framework and model structure. Attention-Guided training framework absorbs the input image’s semantic information based on the translation task. However, it ignores the local context for content extraction and lacks mask comparison in the loss function. The attention mechanism is widely regarded as an effective approach for addressing contextual challenges in machine learning models. By augmenting the model’s capacity to capture long-range dependencies and concentrate on the most salient aspects of the input sequence, the attention mechanism significantly enhances its contextual understanding. Bi-level routing attention stands out among other mechanisms for its computation speed and memory cost. In this paper, we propose an image translation algorithm called Patch-Attention Generative Adversarial Network that combines foreground-background separation processing, bi-level routing attention, and content loss. Our proposed method has been extensively evaluated on diverse datasets, yielding compelling experimental results. These findings demonstrate the substantial performance boost achieved by our approach in the domain of image translation. The generated image is more clarified and understandable compared with other existing approaches.Keywords
This publication has 27 references indexed in Scilit:
- PVT v2: Improved baselines with pyramid vision transformerComputational Visual Media, 2022
- XingGAN for Person Image Generation2020
- Attention-GAN for Object Transfiguration in Wild Images2018
- Diverse Image-to-Image Translation via Disentangled Representations2018
- Deep Image Harmonization2017
- The Cityscapes Dataset for Semantic Urban Scene Understanding2016
- Rethinking the Inception Architecture for Computer Vision2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- FaceNet: A unified embedding for face recognition and clustering2015
- Spatial Pattern Templates for Recognition of Objects with Regular Structure2013