Vision transformer and CNN-based skin lesion analysis: classification of monkeypox
Top Cited Papers
Open Access
- 9 July 2024
- journal article
- research article
- Published by Springer Nature in Multimedia Tools and Applications
- Vol. 83 (28) , 71909-71923
Abstract
Monkeypox is an important health problem. Rapid diagnosis of monkeypox skin lesions and emergency isolation when necessary is essential. Also, some skin lesions, such as melanoma, can be fatal and must be rapidly distinguished. However, in some cases, it is difficult to distinguish the lesions visually. Methods such as dermoscopy, high-resolution ultrasound imaging, etc. can be used for better observation. But these methods are often based on qualitative analysis, subjective and time-consuming. Therefore, in this study, a quantitative and objective classification tool has been developed to assist dermatologists and scientists. The proposed system classifies seven skin lesions, including monkeypox. A popular approach Vision Transformer and some popular deep learning convolutional networks have been trained with the transfer learning approach and all results have been compared. Then, the models that show the best accuracy score have been combined to make the final prediction using bagging-ensemble learning. The proposed ensemble-based system produced 81.91% Accuracy, 65.94% Jaccard, 87.16% Precision, 74.12% Recall, and 78.16% Fscore values. In terms of different criteria metrics, the system produced competitive or even better results than the literature.Keywords
Funding Information
- Sakarya University
This publication has 44 references indexed in Scilit:
- EPVT: Environment-Aware Prompt Vision Transformer for Domain Generalization in Skin Lesion Recognition2023
- Deep Learning‐Based Skin Diseases Classification using SmartphonesAdvanced Intelligent Systems, 2023
- An effective human monkeypox classification using vision transformerInternational Journal of Imaging Systems and Technology, 2023
- Human Monkeypox Classification from Skin Lesion Images with Deep Pre-trained Network using Mobile ApplicationJournal of Medical Systems, 2022
- MDFNet: application of multimodal fusion method based on skin image and clinical data to skin cancer classificationJournal of Cancer Research and Clinical Oncology, 2022
- Automatic skin lesions detection from images through microscopic hybrid features set and machine learning classifiersMicroscopy Research and Technique, 2022
- Automatic segmentation of melanoma skin cancer using transfer learning and fine-tuningMultimedia Systems, 2021
- An explainable stacked ensemble of deep learning models for improved melanoma skin cancer detectionMultimedia Systems, 2021
- End-to-End Object Detection with Transformers2020
- Axial-DeepLab: Stand-Alone Axial-Attention for Panoptic Segmentation2020