A VGG attention vision transformer network for benign and malignant classification of breast ultrasound images
Authors:
- 30 July 2022
- journal article
- research article
- Published by Wiley in Medical Physics
- Vol. 49 (9) , 5787-5798
Abstract
Purpose: Breast cancer is the most commonly occurring cancer worldwide. The ultrasound reflectivity imaging technique can be used to obtain breast ultrasound (BUS) images, which can be used to classify benign and malignant tumors. However, the classification is subjective and dependent on the experience and skill of operators and doctors. The automatic classification method can assist doctors and improve the objectivity, but current convolution neural network (CNN) is not good at learning global features and vision transformer (ViT) is not good at extraction local features. In this study, we proposed a visual geometry group attention ViT (VGGA‐ViT) network to overcome their disadvantages.Methods: In the proposed method, we used a CNN module to extract the local features and employed a ViT module to learn the global relationship among different regions and enhance the relevant local features. The CNN module was named the VGGA module. It was composed of a VGG backbone, a feature extraction fully connected layer, and a squeeze‐and‐excitation block. Both the VGG backbone and the ViT module were pretrained on the ImageNet dataset and retrained using BUS samples in this study. Two BUS datasets were employed for validation.Results: Cross‐validation was conducted on two BUS datasets. For the Dataset A, the proposed VGGA‐ViT network achieved high accuracy (88.711.55%), recall (90.731.57%), specificity (85.583.35%), precision (90.771.98%), F1 score (90.731.24%), and Matthews correlation coefficient (MCC) (76.343.29%), which were better than those of all compared previous networks in this study. The Dataset B was used as a separate test set, the test results showed that the VGGA‐ViT had highest accuracy (81.722.99%), recall (64.452.96%), specificity (90.283.51%), precision (77.087.21%), F1 score (70.114.25%), and MCC (57.646.88%).Conclusions: In this study, we proposed the VGGA‐ViT for the BUS classification, which was good at learning both local and global features. The proposed network achieved higher accuracy than the compared previous methods.Keywords
This publication has 34 references indexed in Scilit:
- ImageNet Large Scale Visual Recognition ChallengeInternational Journal of Computer Vision, 2015
- Fast Implementation of DeLong’s Algorithm for Comparing the Areas Under Correlated Receiver Operating Characteristic CurvesIEEE Signal Processing Letters, 2014
- Breast imaging: A surveyWorld Journal of Clinical Oncology, 2011
- Automated breast cancer detection and classification using ultrasound images: A surveyPattern Recognition, 2010
- Approaches for automated detection and classification of masses in mammogramsPattern Recognition, 2006
- Breast Lesions on Sonograms: Computer-aided Diagnosis with Nearly Setting-Independent Features and Artificial Neural NetworksRadiology, 2003
- Computerized lesion detection on breast ultrasoundMedical Physics, 2002
- Computerized diagnosis of breast lesions on ultrasoundMedical Physics, 2002
- Ideal observer approximation using Bayesian classification neural networksIEEE Transactions on Medical Imaging, 2001
- Using the Kappa Coefficient as a Measure of Reliability or ReproducibilityChest, 1998