The Role of AI-Generated Clinical Image Descriptions in Enhancing Teledermatology Diagnosis: A Cross-Sectional Exploratory Study
Authors:
- Jonathan ShapiroJonathan Shapiro
- Binyamin GreenfieldBGBinyamin Greenfield
- Itay CohenICItay Cohen
- Roni P. Dodiuk-GadRDRoni P. Dodiuk-Gad
- Yuliya Valdman-GrinshpounYVYuliya Valdman-Grinshpoun
- Tamar FreudTFTamar Freud
- Anna LyakhovitskyALAnna Lyakhovitsky
- Ziad KhamaysiZiad Khamaysi
- Emily Avitan-HershEAEmily Avitan-Hersh
Open Access
- 25 January 2026
- journal article
- research article
- Published by MDPI AG in Diagnostics
- Vol. 16 (3) , 384
Abstract
Background/Objectives: AI models such as ChatGPT-4 have shown strong performance in dermatology; however, the diagnostic value of AI-generated clinical image descriptions remains underexplored. This study assesses whether ChatGPT-4’s image descriptions can support accurate dermatologic diagnosis and evaluates their potential integration into the Electronic Medical Record (EMR) system. Materials & Methods: In this Exploratory cross-sectional study, we analyzed images and descriptions from teledermatology consultations conducted between December 2023 and February 2024. ChatGPT-4 generated clinical descriptions for each image, which two senior dermatologists then used to formulate differential diagnoses. Diagnoses based on ChatGPT-4’s output were compared to those derived from the original clinical notes written by teledermatologists. Concordance was categorized as Top1 (exact match), Top3 (correct within top three), Partial, or No match. Results: The study included 154 image descriptions from 67 male and 87 female patients, aged 0 to 93 years. ChatGPT-4 descriptions averaged 74.3 ± 33.1 words, compared to 7.9 ± 3.0 words for teledermatologists. At least one of the two dermatologists achieved a Top 3 concordance rate of 82.5% using ChatGPT-4’s descriptions and 85.3% with teledermatologist descriptions. Conclusions: Preliminary findings highlight the potential integration of ChatGPT-4-generated descriptions into EMRs to enhance documentation. Although AI descriptions were longer, they did not enhance diagnostic accuracy, and expert validation remained essential.Keywords
This publication has 37 references indexed in Scilit:
- Assessing the ChatGPT aptitude: A competent and effective Dermatology doctor?Heliyon, 2024
- The accessibility of digital technologies for people with visual impairment and blindness: a scoping reviewDiscover Computing, 2024
- OpenAI’s GPT-4o in surgical oncology: Revolutionary advances in generative artificial intelligenceEuropean Journal of Cancer, 2024
- Can GPT-4 revolutionize otolaryngology? Navigating opportunities and ethical considerationsAmerican Journal of Otolaryngology, 2024
- Evaluating the performance of Generative Pre-trained Transformer-4 (GPT-4) in standardizing radiology reportsEuropean Radiology, 2023
- Artificial intelligence-assisted dermatology diagnosis: From unimodal to multimodalComputers in Biology and Medicine, 2023
- ChatGPT for healthcare providers and patients: Practical implications within dermatologyJournal of the American Academy of Dermatology, 2023
- Use of teledermatology by dermatology hospitalists is effective in the diagnosis and management of inpatient diseaseJournal of the American Academy of Dermatology, 2021
- Teledermatology in Remote Parts of Chile: Experience in 4 Isolated Rural AreasActas Dermo-Sifiliograficas, 2019
- Teledermatology for the Diagnosis and Management of Skin CancerJAMA Dermatology, 2017