Breast Ultrasound Tumor Classification Using a Hybrid Multitask CNN-Transformer Network
Open Access
- 1 October 2023
- book chapter
- Published by Springer Nature
- Vol. 14223, 344-353
Abstract
Capturing global contextual information plays a critical role in breast ultrasound (BUS) image classification. Although convolutional neural networks (CNNs) have demonstrated reliable performance in tumor classification, they have inherent limitations for modeling global and long-range dependencies due to the localized nature of convolution operations. Vision Transformers have an improved capability of capturing global contextual information but may distort the local image patterns due to the tokenization operations. In this study, we proposed a hybrid multitask deep neural network called Hybrid-MT-ESTAN, designed to perform BUS tumor classification and segmentation using a hybrid architecture composed of CNNs and Swin Transformer components. The proposed approach was compared to nine BUS classification methods and evaluated using seven quantitative metrics on a dataset of 3,320 BUS images. The results indicate that Hybrid-MT-ESTAN achieved the highest accuracy, sensitivity, and F1 score of 82.7%, 86.4%, and 86.0%, respectively.Keywords
All Related Versions
This publication has 20 references indexed in Scilit:
- BUSIS: A Benchmark for Breast Ultrasound Image SegmentationHealthcare, 2022
- A Multi-Task Learning Framework for Automated Segmentation and Classification of Breast Tumors From Ultrasound ImagesUltrasonic Imaging, 2022
- Evaluation of Complexity Measures for Deep Learning Generalization in Medical Image AnalysisIEEE Workshop on Machine Learning for Signal Processing, 2021
- Swin Transformer: Hierarchical Vision Transformer using Shifted Windows2021
- Breast ultrasound tumor image classification using image decomposition and fusion based on adaptive multi-model spatial feature fusionComputer Methods and Programs in Biomedicine, 2021
- SHA-MTL: soft and hard attention multi-task learning for automated breast cancer ultrasound image segmentation and classificationInternational Journal of Computer Assisted Radiology and Surgery, 2021
- Stan: Small Tumor-Aware Network for Breast Ultrasound Image Segmentation2020
- Breast ultrasound lesions recognition: end-to-end deep learning approachesJournal of Medical Imaging, 2018
- Automated Breast Ultrasound Lesions Detection Using Convolutional Neural NetworksIEEE Journal of Biomedical and Health Informatics, 2017
- Densely Connected Convolutional Networks2017