TaiChiNet: Negative-Positive Cross-Attention Network for Breast Lesion Segmentation in Ultrasound Images
- 11 January 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Journal of Biomedical and Health Informatics
- Vol. 28 (3) , 1516-1527
Abstract
Breast lesion segmentation in ultrasound images is essential for computer-aided breast-cancer diagnosis. To improve the segmentation performance, most approaches design sophisticated deep-learning models by mining the patterns of foreground lesions and normal backgrounds simultaneously or by unilaterally enhancing foreground lesions via various focal losses. However, the potential of normal backgrounds is underutilized, which could reduce false positives by compacting the feature representation of all normal backgrounds. From a novel viewpoint of bilateral enhancement, we propose a negative-positive cross-attention network to concentrate on normal backgrounds and foreground lesions, respectively. Derived from the complementing opposites of bipolarity in TaiChi, the network is denoted as TaiChiNet, which consists of the negative normal-background and positive foreground-lesion paths. To transmit the information across the two paths, a cross-attention module, a complementary MLP-head, and a complementary loss are built for deep-layer features, shallow-layer features, and mutual-learning supervision, separately. To the best of our knowledge, this is the first work to formulate breast lesion segmentation as a mutual supervision task from the foreground-lesion and normal-background views. Experimental results have demonstrated the effectiveness of TaiChiNet on two breast lesion segmentation datasets with a lightweight architecture. Furthermore, extensive experiments on the thyroid nodule segmentation and retinal optic cup/disc segmentation datasets indicate the application potential of TaiChiNet.Keywords
Funding Information
- National Natural Science Foundation of China (62371219, 61771233, 62271221)
- Basic and Applied Basic Research Foundation of Guangdong Province (2023A1515011260)
- Science and Technology Program of Guangzhou (202201011672)
- SERC Central Research Fund
This publication has 43 references indexed in Scilit:
- X-Net: a dual encoding–decoding method in medical image segmentationThe Visual Computer, 2021
- Residual Feedback Network for Breast Lesion Segmentation in Ultrasound Image2021
- Collaborative Video Object Segmentation by Foreground-Background Integration2020
- A Second-Order Subregion Pooling Network for Breast Lesion Segmentation in Ultrasound2020
- Breast ultrasound region of interest detection and lesion localisationArtificial Intelligence in Medicine, 2020
- Breast Cancer Metastasis and Drug Resistance2019
- Automatic tumor segmentation in breast ultrasound images using a dilated fully convolutional network combined with an active contour modelMedical Physics, 2018
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Detection of Breast Cancer With Addition of Annual Screening Ultrasound or a Single Screening MRI to Mammography in Women With Elevated Breast Cancer RiskJAMA, 2012
- Combined Screening With Ultrasound and Mammography vs Mammography Alone in Women at Elevated Risk of Breast CancerJAMA, 2008