Attention-Guided Erasing for Enhanced Transfer Learning in Breast Abnormality Classification
Preprint
- 23 April 2024
- preprint
- Published by Springer Nature in Research Square
Abstract
Purpose: Breast cancer remains one of the most prevalent cancers globally, necessitating effective early screening and diagnosis. This study investigates the effectiveness and generalizability of our recently proposed data augmentation technique, attention-guided erasing (AGE), across various transfer learning classification tasks for breast abnormality classification in mammography. Methods: AGE utilizes attention head visualizations from DINO self-supervised pretraining to weakly localize regions of interest (ROI) in images. These localizations are then used to stochastically erase non-essential background information from training images during transfer learning. Our research evaluates AGE across two image-level and three patch-level classification tasks. The image-level tasks involve breast density categorization in digital mammography (DM) and malignancy classification in contrast-enhanced mammography (CEM). Patch-level tasks include classifying calcifications and masses in scanned film mammography (SFM), as well as malignancy classification of ROIs in CEM. Results: AGE significantly boosts classification performance with statistically significant improvements in mean F1-scores across four tasks compared to baselines. Specifically, for image-level classification of breast density in DM and malignancy in CEM, we achieve gains of 2% and 1.5%, respectively. Additionally, for patch-level classification of calcifications in SFM and CEM ROIs, gains of 0.4% and 0.6% are observed, respectively. However, marginal improvement is noted in the mass classification task, indicating the necessity for further optimization in tasks where critical features may be obscured by erasing techniques. Conclusion: Our findings underscore the potential of AGE, a dataset- and task-specific augmentation strategy powered by self-supervised learning, to enhance the downstream classification performance of deep learning models, particularly involving Vision Transformers, in medical imaging.Keywords
All Related Versions
This publication has 10 references indexed in Scilit:
- Enhancing downstream classification of breast abnormalities in contrast enhanced spectral mammography using a neighborhood representation loss2024
- VinDr-Mammo: A large-scale benchmark dataset for computer-aided diagnosis in full-field digital mammographyScientific Data, 2023
- A novel multi-view deep learning approach for BI-RADS and density assessment of mammogramsAnnual International Conference of the IEEE Engineering in Medicine and Biology Society, 2022
- Categorized contrast enhanced mammography dataset for diagnostic and artificial intelligence researchScientific Data, 2022
- Contrast-enhanced Mammography: How Does It Work?RadioGraphics, 2021
- Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 CountriesCA: A Cancer Journal for Clinicians, 2021
- Contrast-Enhanced Spectral Mammography in Women With Intermediate Breast Cancer Risk and Dense BreastsAmerican Journal of Roentgenology, 2018
- A curated mammography data set for use in computer-aided detection and diagnosis researchScientific Data, 2017
- Risk Factors of Female Breast Cancer in Vietnam: A Case-Control StudyCancer Research and Treatment, 2017
- The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information RepositoryJournal of Digital Imaging, 2013