Evaluation of ChatGPT’s responses to frequently asked questions from osteosarcoma patients: A descriptive cross-sectional study
Open Access
- 24 April 2026
- journal article
- research article
- Published by Wolters Kluwer Health in Medicine
- Vol. 105 (17) , e48539
Abstract
To evaluate the clinical appropriateness of ChatGPT’s responses to questions frequently asked by osteosarcoma patients and their families. Ten questions frequently asked by osteosarcoma patients and their families were identified. Each question was submitted to OpenAI’s GPT-5-based ChatGPT (August 2025 version) using separate user accounts. Two orthopedic oncology specialists independently evaluated the responses for clinical appropriateness using a 4-point Likert scale. Interrater agreement was analyzed with weighted Cohen kappa. Interrater agreement was found to be substantial ( K = 0.667). One response was rated as an excellent response that did not require clarification, 5 responses were rated as satisfactory responses that required minimal clarification, and 4 responses were rated as satisfactory responses that required moderate clarification. There were no unsatisfactory responses requiring substantial clarification. ChatGPT’s responses to osteosarcoma-related questions were found to be largely clinically appropriate. Nevertheless, given its limitations, artificial intelligence should be regarded as a supportive tool that requires physician oversight.Keywords
This publication has 33 references indexed in Scilit:
- Chemotherapy induced neurotoxicity in cancer survivors assessed through a dual database bibliometric analysis from 2005 to 2025Discover Oncology, 2025
- Bibliometric analysis of immune-related acute kidney injury induced by cancer immunotherapy (2000–2025)Naunyn-Schmiedeberg's Archives of Pharmacology, 2025
- Comments on “The impact of artificial intelligence on the adenoma detection rate: comparison between experienced, intermediate and trainee endoscopists’ adenoma detection rate”Wiener klinische Wochenschrift, 2025
- The impact of artificial intelligence on the adenoma detection rateWiener klinische Wochenschrift, 2025
- Comparing Physician and Artificial Intelligence Chatbot Responses to Patient Questions Posted to a Public Social Media ForumJAMA Internal Medicine, 2023
- OsteosarcomaPediatric Blood & Cancer, 2020
- Survival and prognosis with osteosarcoma: outcomes in more than 2000 patients in the EURAMOS-1 (European and American Osteosarcoma Study) cohortEuropean Journal of Cancer, 2019
- Osteosarcoma OverviewRheumatology and Therapy, 2016
- Psychosocial and functional outcomes in long‐term survivors of osteosarcoma: A comparison of limb‐salvage surgery and amputationPediatric Blood & Cancer, 2010
- Periosteal osteosarcoma – a European review of outcomeEuropean Journal of Cancer, 2005