U-Net v2: Rethinking the Skip Connections of U-Net for Medical Image Segmentation
Authors:
Preprint
Abstract
In this paper, we introduce U-Net v2, a new robust and efficient U-Net variant for medical image segmentation. It aims to augment the infusion of semantic information into low-level features while simultaneously refining high-level features with finer details. For an input image, we begin by extracting multi-level features with a deep neural network encoder. Next, we enhance the feature map of each level by infusing semantic information from higher-level features and integrating finer details from lower-level features through Hadamard product. Our novel skip connections empower features of all the levels with enriched semantic characteristics and intricate details. The improved features are subsequently transmitted to the decoder for further processing and segmentation. Our method can be seamlessly integrated into any Encoder-Decoder network. We evaluate our method on several public medical image segmentation datasets for skin lesion segmentation and polyp segmentation, and the experimental results demonstrate the segmentation accuracy of our new method over state-of-the-art methods, while preserving memory and computational efficiency. Code is available at: https://github.com/yaoppeng/U-Net\_v2Keywords
All Related Versions
This publication has 13 references indexed in Scilit:
- EGE-UNet: An Efficient Group Enhanced UNet for Skin Lesion Segmentation2023
- MDU-Net: multi-scale densely connected U-Net for biomedical image segmentationHealth Information Science and Systems, 2023
- MALUNet: A Multi-Attention and Light-weight UNet for Skin Lesion Segmentation2022
- PraNet: Parallel Reverse Attention Network for Polyp Segmentation2020
- CBAM: Convolutional Block Attention Module2018
- UNet++: A Nested U-Net Architecture for Medical Image Segmentation2018
- Pyramid Scene Parsing Network2017
- Deep Residual Learning for Image Recognition2016
- WM-DOVA maps for accurate polyp highlighting in colonoscopy: Validation vs. saliency maps from physiciansComputerized Medical Imaging and Graphics, 2015
- Toward embedded detection of polyps in WCE images for early diagnosis of colorectal cancerInternational Journal of Computer Assisted Radiology and Surgery, 2013