DA-CTransNet: A Transformer-CNN Hybrid Framework for Dermoscopy ImageSegmentation via Domain Adaptation and Cascaded Boundary Refinement
Open Access
- 15 May 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 42-48
Abstract
Accurate skin lesion segmentation is a critical foundation for computer-aided dermoscopic diagnosis. Existing CNN-Transformer hybrid methods still fall short in achieving deep fusion of global semantics and local details, as well as in task-specific boundary guidance mechanisms, especially given the core challenges in dermoscopy images: highly blurred lesion boundaries, complex and variable internal textures, and ubiquitous interference from hair occlusion and illumination artifacts. To address these issues, this paper proposes a novel segmentation network named DA-CTransNet, which deeply integrates three core modules: domain-knowledge-aware adaptive attention, multi-scale collaborative affine calibration, and cascaded boundary refinement. Specifically: First, we construct a domain-knowledge adaptive module that encodes clinically validated key visual diagnostic patterns (e.g., textures and vascular structures of specific lesions) into learnable feature prompt vectors via a lightweight sub-network, and adaptively injects them into the self-attention computation of the Transformer to achieve targeted enhancement of semantic features. Second, we propose a multi-scale collaborative affine calibration mechanism that, based on cross-spatial and cross-channel attention interaction, explicitly estimates and compensates for statistical distribution and spatial geometric discrepancies among features from different levels, constructing an intrinsically consistent and aligned feature pyramid. Finally, we design a dual-pathway cascaded boundary refinement decoder: the global pathway performs coarse segmentation, while the boundary pathway introduces a spectral-aware uncertainty mapping module to locate blurred boundary regions, combined with a high-order edge-preserving loss for end-to-end learning to achieve sub-pixel boundary reconstruction. Extensive experiments on the ISIC 2017 and ISIC 2018 datasets demonstrate that, compared to the baseline model, DA-CTransNet improves the Dice coefficient by approximately 2.3%, with significant improvements in Boundary F1 score and HD95 metrics; compared to existing mainstream methods, the Hausdorff distance is reduced by approximately 15%, and the model exhibits stronger robustness on images containing artifacts. This study provides a new technical pathway for building high-performance clinical intelligent auxiliary systems.This publication has 20 references indexed in Scilit:
- Self-assembly of the smallest and tightest molecular trefoil knotNature Communications, 2024
- Space-feature measures on meshes for mapping spatial transcriptomicsMedical Image Analysis, 2023
- Visual Prompt Tuning2022
- Automatic Segmentation of Hip Osteophytes in DXA Scans Using U-Nets2022
- Unsupervised domain adaptation for clinician pose estimation and instance segmentation in the operating roomMedical Image Analysis, 2022
- A survey of loss functions for semantic segmentation2020
- PraNet: Parallel Reverse Attention Network for Polyp Segmentation2020
- Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation2018
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016