Skin Cancer Detection Using Transfer Learning and Deep Attention Mechanisms
Top Cited Papers
Open Access
- 3 January 2025
- journal article
- research article
- Published by MDPI AG in Diagnostics
- Vol. 15 (1) , 99
Abstract
Background/Objectives: Early and accurate diagnosis of skin cancer improves survival rates; however, dermatologists often struggle with lesion detection due to similar pigmentation. Deep learning and transfer learning models have shown promise in diagnosing skin cancers through image processing. Integrating attention mechanisms (AMs) with deep learning has further enhanced the accuracy of medical image classification. While significant progress has been made, further research is needed to improve the detection accuracy. Previous studies have not explored the integration of attention mechanisms with the pre-trained Xception transfer learning model for binary classification of skin cancer. This study aims to investigate the impact of various attention mechanisms on the Xception model’s performance in detecting benign and malignant skin lesions. Methods: We conducted four experiments on the HAM10000 dataset. Three models integrated self-attention (SL), hard attention (HD), and soft attention (SF) mechanisms, while the fourth model used the standard Xception without attention mechanisms. Each mechanism analyzed features from the Xception model uniquely: self-attention examined the input relationships, hard-attention selected elements sparsely, and soft-attention distributed the focus probabilistically. Results: Integrating AMs into the Xception architecture effectively enhanced its performance. The accuracy of the Xception alone was 91.05%. With AMs, the accuracy increased to 94.11% using self-attention, 93.29% with soft attention, and 92.97% with hard attention. Moreover, the proposed models outperformed previous studies in terms of the recall metrics, which are crucial for medical investigations. Conclusions: These findings suggest that AMs can enhance performance in relation to complex medical imaging tasks, potentially supporting earlier diagnosis and improving treatment outcomes.Keywords
All Related Versions
This publication has 43 references indexed in Scilit:
- Deep Learning-Based Classification for Melanoma Detection Using XceptionNetJournal of Healthcare Engineering, 2022
- Deep Learning-Based Transfer Learning for Classification of Skin CancerSensors, 2021
- Biopsy-free in vivo virtual histology of skin using deep learningLight: Science & Applications, 2021
- Skin cancer detection from dermoscopic images using deep learning and fuzzy k‐means clusteringMicroscopy Research and Technique, 2021
- The Development of a Skin Cancer Classification System for Pigmented Skin Lesions Using Deep LearningBiomolecules, 2020
- Dermoscopy Image Analysis: Overview and Future DirectionsIEEE Journal of Biomedical and Health Informatics, 2019
- The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesionsScientific Data, 2018
- A Survey of Feature Extraction in Dermoscopy Image Analysis of Skin CancerIEEE Journal of Biomedical and Health Informatics, 2018
- Nonmelanoma skin cancer in Saudi Arabia: single center experienceAnnals of Saudi Medicine, 2018
- Incidence and Trends of Basal Cell Carcinoma and Cutaneous Squamous Cell CarcinomaMayo Clinic Proceedings, 2017