A Robust Hybrid CNN+ViT Framework for Breast Cancer Classification Using Mammogram Images
Open Access
- 22 April 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 13, 77187-77195
Abstract
Breast cancer is the most frequent type of cancer largely experienced by women currently, although it could happen to men also. It appears when abnormal breast tissue cells grow rapidly and form tumors. Mammogram is a technique that is employed by doctors to analyse the breast in the diagnosis of early cancer. These mammograms are classified into Benign and Malignant. This research addresses the variability and potential oversight in radiologists’ manual mammogram interpretations, aiming to enhance classification accuracy by combining Convolution Neural Networks (CNNs) and Vision Transformers (ViTs). CNN is a successful image classification that uses hierarchical feature extraction, ViTs capture the global context but require substantial data and computation. In this research, we have used CLAHE-enhanced mammogram images from Kaggle for training and applied a CNN+ViT model. We have also used a few pre-trained models such as DenseNet, Inception, SE Resnet, and XceptionNet for comparative analysis. The CNN+ViT model gave us an accuracy of 90.1% showing robust performance. Although XceptionNet achieved perfect accuracy, it may indicate overfitting.Keywords
This publication has 31 references indexed in Scilit:
- RI-ViT: A Multi-Scale Hybrid Method Based on Vision Transformer for Breast Cancer Detection in Histopathological ImagesIEEE Access, 2024
- Breast Tumor Classification with Enhanced Transfer Learning Features and Selection Using Chaotic Map-Based OptimizationInternational Journal of Computational Intelligence Systems, 2024
- YOLO-based CAD framework with ViT transformer for breast mass detection and classification in CESM and FFDM imagesNeural Computing and Applications, 2024
- Enhanced melanoma detection using a fuzzy ensemble approach integrating hybrid optimization algorithmBiomedical Signal Processing and Control, 2024
- State-of-the-art review of applications of image processing techniques for tool condition monitoring on conventional machining processesThe International Journal of Advanced Manufacturing Technology, 2023
- A Yolo-Based Model for Breast Cancer Detection in MammogramsCognitive Computation, 2023
- Breast Cancer Detection Using Mammographic Images over Convolutional Neural Network2023
- Breast cancer classification on thermograms using deep CNN and transformersQuantitative InfraRed Thermography Journal, 2022
- Ethiopian women's breast cancer self-examination practices and associated factors. A systematic review and meta-analysisCancer Epidemiology, 2022
- Multi-Deep CNN based Experimentations for Early Diagnosis of Breast CancerIETE Journal of Research, 2022