iReWindColor v2: Cross-Window Enhanced Transformer for Point Interactive Image Colorization
Open Access
- 9 September 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 158494-158503
Abstract
Point-interactive image colorization is a task that enables users to add color to grayscale images by providing sparse color annotations (hints) at user-defined locations. These hints are then propagated across the image to generate a plausible colorization result with minimal user effort. While existing methods have demonstrated effectiveness in leveraging user input, they often suffer from excessive color diffusion and color bleeding beyond object boundaries, compromising visual fidelity. In this work, we present an extended version of our previous method, iReWindColor, which introduced a window-based Vision Transformer (ViT) framework for efficient and fine-grained colorization. The extended framework incorporates two key improvements. First, we enhance the Window Encoder by integrating Window-Connecting Convolution module, which enables information exchange across adjacent windows. This addition mitigates discontinuities at window boundaries and improves spatial coherence in the colorized output. Second, we provide a comprehensive ablation study to quantitatively assess the impact of each architectural component and design choice, offering deeper insights into the effectiveness of the proposed modifications. Our approach employs small patches to achieve detailed color propagation while maintaining computational efficiency through localized attention. The Residual Embedding mechanism remains integral to aggregating global context, whereas the proposed Encode Block, which combines Self-Attention and Convolutional Neural Networks (CNNs), strengthens inter-patch relationships and improves the utilization of user-provided hints. Experimental results on multiple benchmark datasets demonstrate that the extended model consistently outperforms the original iReWindColor as well as other state-of-the-art methods, producing visually coherent, user-aligned colorizations with improved computational efficiency.Keywords
This publication has 37 references indexed in Scilit:
- BigColor: Colorization Using a Generative Color Prior for Natural Images2022
- $\mathrm {CT^2}$: Colorization Transformer via Color Tokens2022
- ColorFormer: Image Colorization via Color Memory Assisted Hybrid-Attention Transformer2022
- The unreasonable effectiveness of deep learning in artificial intelligenceProceedings of the National Academy of Sciences, 2020
- Pixelated Semantic ColorizationInternational Journal of Computer Vision, 2019
- Colorful Image Colorization2016
- Learning Representations for Automatic Colorization2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Scope of validity of PSNR in image/video quality assessmentElectronics Letters, 2008