Attention-augmented U-Net (AA-U-Net) for semantic segmentation
- 25 July 2022
- journal article
- research article
- Published by Springer Nature in Signal, Image and Video Processing
- Vol. 17 (4) , 981-989
Abstract
Deep learning-based image segmentation models rely strongly on capturing sufficient spatial context without requiring complex models that are hard to train with limited labeled data. For COVID-19 infection segmentation on CT images, training data are currently scarce. Attention models, in particular the most recent self-attention methods, have shown to help gather contextual information within deep networks and benefit semantic segmentation tasks. The recent attention-augmented convolution model aims to capture long range interactions by concatenating self-attention and convolution feature maps. This work proposes a novel attention-augmented convolution U-Net (AA-U-Net) that enables a more accurate spatial aggregation of contextual information by integrating attention-augmented convolution in the bottleneck of an encoder–decoder segmentation architecture. A deep segmentation network (U-Net) with this attention mechanism significantly improves the performance of semantic segmentation tasks on challenging COVID-19 lesion segmentation. The validation experiments show that the performance gain of the attention-augmented U-Net comes from their ability to capture dynamic and precise (wider) attention context. The AA-U-Net achieves Dice scores of 72.3% and 61.4% for ground-glass opacity and consolidation lesions for COVID-19 segmentation and improves the accuracy by 4.2% points against a baseline U-Net and 3.09% points compared to a baseline U-Net with matched parameters.Keywords
This publication has 26 references indexed in Scilit:
- Using Artificial Intelligence to Detect COVID-19 and Community-acquired Pneumonia Based on Pulmonary CT: Evaluation of the Diagnostic AccuracyRadiology, 2020
- Deep Learning-based Detection for COVID-19 from Chest CT using Weak LabelmedRxiv, 2020
- Machine learning-based CT radiomics model for predicting hospital stay in patients with pneumonia associated with SARS-CoV-2 infection: A multicenter studymedRxiv, 2020
- Deep learning-based model for detecting 2019 novel coronavirus pneumonia on high-resolution computed tomography: a prospective studymedRxiv, 2020
- CCNet: Criss-Cross Attention for Semantic Segmentation2019
- Attention Augmented Convolutional Networks2019
- Attention gated networks: Learning to leverage salient regions in medical imagesMedical Image Analysis, 2019
- Non-local Neural Networks2018
- Cyclical Learning Rates for Training Neural Networks2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015