MiSC: A hybrid multi-modal deep learning approach for accurate skin cancer detection
Open Access
- 4 June 2025
- journal article
- research article
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 84 (36) , 45321-45345
Abstract
With skin cancer rates increasing globally due to factors like prolonged ultraviolet exposure, early and accurate detection methods are crucial in managing and mitigating the disease. Implementing innovative diagnostic techniques can significantly enhance early intervention, improving patient outcomes and survival rates. This research aims to precisely identify and classify six skin cancer types. The proposed method integrates clinical images and metadata into a hybrid deep learning model, leveraging feature extraction and classification. The proposed approach employs seven machine learning algorithms alongside ten pre-trained deep learning models, notably featuring MobileNetV2 for image feature extraction, logistic regression for image classification, and random forest for metadata analysis. The developed approach is tested with the PAD-UFES-20 dataset and it demonstrate a notable improvement in diagnostic accuracy (95.6%), precision (96.8%), recall (95.6%), and F1-Score (95.7%). This findings highlight the significant contribution of metadata in enhancing classification accuracy, surpassing image-based methods alone.Keywords
All Related Versions
Funding Information
- Nile University
This publication has 23 references indexed in Scilit:
- Analysis of the ISIC image datasets: Usage, benchmarks and recommendationsMedical Image Analysis, 2022
- Deep attention branch networks for skin lesion classificationComputer Methods and Programs in Biomedicine, 2021
- Skin cancer disease images classification using deep learning solutionsMultimedia Tools and Applications, 2021
- The influence of climate change on skin cancer incidence – A review of the evidenceInternational Journal of Women's Dermatology, 2021
- PAD-UFES-20: A skin lesion dataset composed of patient data and clinical images collected from smartphonesData in Brief, 2020
- Skin lesion classification using ensembles of multi-resolution EfficientNets with meta dataMethodsX, 2020
- Skin Lesion Classification Using Convolutional Neural Network With Novel RegularizerIEEE Access, 2019
- The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesionsScientific Data, 2018
- A conditional statistical shape model with integrated error estimation of the conditions; Application to liver segmentation in non-contrast CT imagesMedical Image Analysis, 2014
- Topical calcineurin inhibitors in cutaneous lupus erythematosusArchives of Dermatological Research, 2008