Comparative Analysis of AI Models for Atypical Pigmented Facial Lesion Diagnosis
Authors:
- Alessandra CartocciACAlessandra Cartocci
- Alessio LuschiAlessio Luschi
- Linda TognettiLinda Tognetti
- Elisa CinottiECElisa Cinotti
- Francesca FarnetaniFFFrancesca Farnetani
- Aimilios LallasAimilios Lallas
- John PaoliJPJohn Paoli
- Caterina LongoCLCaterina Longo
- Elvira MoscarellaEMElvira Moscarella
- Danica TiodorovicDTDanica Tiodorovic
- Ignazio StanganelliIgnazio Stanganelli
- Mariano SuppaMSMariano Suppa
Open Access
- 17 October 2024
- journal article
- research article
- Published by MDPI AG in Bioengineering
- Vol. 11 (10) , 1036
Abstract
Diagnosing atypical pigmented facial lesions (aPFLs) is a challenging topic for dermatologists. Accurate diagnosis of these lesions is crucial for effective patient management, especially in dermatology, where visual assessment plays a central role. Incorrect diagnoses can result in mismanagement, delays in appropriate interventions, and potential harm. AI, however, holds the potential to enhance diagnostic accuracy and provide reliable support to clinicians. This work aimed to evaluate and compare the effectiveness of machine learning (logistic regression of lesion features and patient metadata) and deep learning (CNN analysis of images) models in dermoscopy diagnosis and the management of aPFLs. This study involved the analysis of 1197 dermoscopic images of facial lesions excised due to suspicious and histologically confirmed malignancy, classified into seven classes (lentigo maligna—LM; lentigo maligna melanoma—LMM; atypical nevi—AN; pigmented actinic keratosis—PAK; solar lentigo—SL; seborrheic keratosis—SK; and seborrheic lichenoid keratosis—SLK). Image samples were collected through the Integrated Dermoscopy Score (iDScore) project. The statistical analysis of the dataset shows that the patients mean age was 65.5 ± 14.2, and the gender was equally distributed (580 males—48.5%; 617 females—51.5%). A total of 41.7% of the sample constituted malignant lesions (LM and LMM). Meanwhile, the benign lesions were mainly PAK (19.3%), followed by SL (22.2%), AN (10.4%), SK (4.0%), and SLK (2.3%). The lesions were mainly localised in the cheek and nose areas. A stratified analysis of the assessment provided by the enrolled dermatologists was also performed, resulting in 2445 evaluations of the 1197 images (2.1 evaluations per image on average). The physicians demonstrated higher accuracy in differentiating between malignant and benign lesions (71.2%) than in distinguishing between the seven specific diagnoses across all the images (42.9%). The logistic regression model obtained a precision of 39.1%, a sensitivity of 100%, a specificity of 33.9%, and an accuracy of 53.6% on the test set, while the CNN model showed lower sensitivity (58.2%) and higher precision (47.0%), specificity (90.8%), and accuracy (59.5%) for melanoma diagnosis. This research demonstrates how AI can enhance the diagnostic accuracy in complex dermatological cases like aPFLs by integrating AI models with clinical data and evaluating different diagnostic approaches, paving the way for more precise and scalable AI applications in dermatology, showing their critical role in improving patient management and the outcomes in dermatology.Keywords
This publication has 24 references indexed in Scilit:
- The Arrival of Artificial Intelligence Large Language Models and Vision-Language Models: A Potential to Possible Change in the Paradigm of Healthcare Delivery in DermatologyJournal of Investigative Dermatology, 2024
- Global Burden of Cutaneous Melanoma in 2020 and Projections to 2040JAMA Dermatology, 2022
- Assessment of Diagnostic Accuracy of Dermoscopic Structures and Patterns Used in Melanoma DetectionJAMA Dermatology, 2021
- A new deep learning approach integrated with clinical data for the dermoscopic differentiation of early melanomas from atypical neviJournal of Dermatological Science, 2021
- The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesionsScientific Data, 2018
- DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFsIEEE Transactions on Pattern Analysis and Machine Intelligence, 2017
- Deep learningNature, 2015
- Probabilistic machine learning and artificial intelligenceNature, 2015
- A semi-supervised approach to extract pharmacogenomics-specific drug–gene pairs from biomedical literature for personalized medicineJournal of Biomedical Informatics, 2013
- Diagnostic accuracy of dermoscopyThe Lancet Oncology, 2002