Artificial intelligence for image recognition in diagnosing oral and oropharyngeal cancer and leukoplakia
Open Access
- 29 January 2025
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 15 (1) , 1-10
Abstract
Visual diagnosis is one of the key features of squamous cell carcinoma of the oral cavity (OSCC) and oropharynx (OPSCC), both subsets of head and neck squamous cell carcinoma (HNSCC) with a heterogeneous clinical appearance. Advancements in artificial intelligence led to Image recognition being introduced recently into large language models (LLMs) such as ChatGPT 4.0. This exploratory study, for the first time, evaluated the application of image recognition by ChatGPT to diagnose squamous cell carcinoma and leukoplakia based on clinical images, with images without any lesion as a control group. A total of 45 clinical images were analyzed, comprising 15 cases each of SCC, leukoplakia, and non-lesion images. ChatGPT 4.0 was tasked with providing the most likely diagnosis based on these images in scenario one. In scenario two the image and the clinical history were provided, whereas in scenario three only the clinical history was given. The results and the accuracy of the LLM were rated by two independent reviewers and the overall performance was evaluated using the modified Artificial Intelligence Performance Index (AIPI. In this study, ChatGPT 4.0 demonstrated the ability to correctly identify leukoplakia cases using image recognition alone, while the ability to diagnose SCC was insufficient, but improved by including the clinical history in the prompt. Providing only the clinical history resulted in a misclassification of most leukoplakia and some SCC cases. Oral cavity lesions were more likely to be diagnosed correctly. In this exploratory study of 45 images of oral lesions, ChatGPT 4.0 demonstrated a convincing performance for detecting SCC only when the clinical history was added, whereas Leukoplakia was detected solely by image recognition. ChatGPT is therefore currently insufficient for reliable OPSCC and OSCC diagnosis, but further technological advancements may pave the way for the use in the clinical setting.Keywords
Funding Information
- Technische Universität München
This publication has 40 references indexed in Scilit:
- Leveraging Large Language Models for Decision Support in Personalized OncologyJAMA Network Open, 2023
- Performance of Liquid Biopsy for Diagnosis and Surveillance of Human Papillomavirus–Associated Oropharyngeal CancerJAMA Otolaryngology–Head & Neck Surgery, 2023
- ChatGPT performance in laryngology and head and neck surgery: a clinical case-seriesEuropean Archives of Oto-Rhino-Laryngology, 2023
- Validity and reliability of an instrument evaluating the performance of intelligent chatbot: the Artificial Intelligence Performance Instrument (AIPI)European Archives of Oto-Rhino-Laryngology, 2023
- Evaluating ChatGPT as an adjunct for the multidisciplinary tumor board decision-making in primary breast cancer casesArchives of Gynecology and Obstetrics, 2023
- Accuracy of a Generative Artificial Intelligence Model in a Complex Diagnostic ChallengeJAMA, 2023
- ChatGPT—A promising generative AI tool and its implications for cancer careCancer, 2023
- Cell‐free human papillomavirus DNA kinetics after surgery for human papillomavirus–associated oropharyngeal cancerCancer, 2022
- Review at a multidisciplinary tumor board impacts critical management decisions of pediatric patients with cancerPediatric Blood & Cancer, 2016
- Principal component analysis and artificial neural network analysis of oral tissue fluorescence spectra: Classification of normal premalignant and malignant pathological conditionsBiopolymers, 2006