Accuracy of ChatGPT in head and neck oncological board decisions: preliminary findings
- 22 November 2023
- journal article
- research article
- Published by Springer Nature in European Archives of Oto-Rhino-Laryngology
- Vol. 281 (4) , 2105-2114
Abstract
Objectives To evaluate the ChatGPT-4 performance in oncological board decisions. Methods Twenty medical records of patients with head and neck cancer were evaluated by ChatGPT-4 for additional examinations, management, and therapeutic approaches. The ChatGPT-4 propositions were assessed with the Artificial Intelligence Performance Instrument. The stability of ChatGPT-4 was evaluated through regenerated answers at 1-day interval. Results ChatGPT-4 provided adequate explanations for cTNM staging in 19 cases (95%). ChatGPT-4 proposed a significant higher number of additional examinations than practitioners (72 versus 103; p = 0.001). ChatGPT-4 indications of endoscopy–biopsy, HPV research, ultrasonography, and PET–CT were consistent with the oncological board decisions. The therapeutic propositions of ChatGPT-4 were accurate in 13 cases (65%). Most additional examination and primary treatment propositions were consistent throughout regenerated response process. Conclusions ChatGPT-4 may be an adjunctive theoretical tool in oncological board simple decisions.Keywords
This publication has 15 references indexed in Scilit:
- Validity and reliability of an instrument evaluating the performance of intelligent chatbot: the Artificial Intelligence Performance Instrument (AIPI)European Archives of Oto-Rhino-Laryngology, 2023
- Accuracy of ChatGPT‐Generated Information on Head and Neck and Oromaxillofacial Surgery: A Multicenter Collaborative AnalysisOtolaryngology–Head and Neck Surgery, 2023
- Exploring the potential of Chat-GPT as a supportive tool for sialendoscopy clinical decision making and patient information supportEuropean Archives of Oto-Rhino-Laryngology, 2023
- ChatGPT’s quiz skills in different otolaryngology subspecialties: an analysis of 2576 single-choice and multiple-choice board certification preparation questionsEuropean Archives of Oto-Rhino-Laryngology, 2023
- Research Letter: Application of GPT-4 to select next-step antidepressant treatment in major depressionmedRxiv, 2023
- A Chat(GPT) about the future of scientific publishingBrain, Behavior, and Immunity, 2023
- European Head and Neck Society recommendations for head and neck cancer survivorship careOral Oncology, 2022
- Salvage carbon dioxide transoral laser microsurgery for laryngeal cancer after (chemo)radiotherapy: a European Laryngological Society consensus statementEuropean Archives of Oto-Rhino-Laryngology, 2021
- Head and neck cancers—major changes in the American Joint Committee on cancer eighth edition cancer staging manualCA: A Cancer Journal for Clinicians, 2017
- French Society of ENT (SFORL) guidelines for care pathway organization in head and neck oncology (short version). Early management of head and neck cancerEuropean Annals of Otorhinolaryngology, Head and Neck Diseases, 2015