The Potential of Large Language Models in Gynecologic Oncology Telephone Triage
Open Access
- 6 November 2026
- journal article
- research article
- Published by MDPI AG in Diagnostics
- Vol. 16 (21) , 3668
Abstract
Introduction: Nurse-led telephone triage, frequently guided by the United Kingdom Oncology Nursing Society (UKONS) tool, is a cornerstone of supportive oncology care, yet the appropriateness of triage decisions varies across settings. Large Language Models (LLMs) show promise in medical communication but remain unvalidated for autonomous clinical decision-making, particularly in gynecologic oncology, where remote and telephone-based care pose distinct challenges. Methods and Materials: Twenty fictitious case vignettes representing common treatment-related toxicities in gynecologic oncology were developed. Three board-certified gynecologic consultants independently assigned UKONS Red–Amber–Green (RAG) triage categories, reaching unanimous consensus that served as the reference standard. Vignettes were submitted verbatim, as single-turn queries with no follow-up prompting, to three publicly available LLMs (OpenEvidence, ChatGPT, Google Gemini). LLM responses were mapped to RAG categories and compared descriptively against the reference standard, stratified by treatment type and platform. Results: All three LLMs achieved 100% concordance with the reference standard for all Red cases across both treatment groups, with no high-acuity case downgraded to self-care. Discrepancies clustered at lower-acuity boundaries. In the chemotherapy-alone group, errors were limited to omission of an explicit 24-h follow-up window for 1 Amber-rated complaints. In the combined group, all LLMs over-triaged intermediate-risk complaints toward immediate or same-day evaluation; low-risk complaints showed more variable over-triage. Conclusions: LLMs identified unambiguous emergent gynecologic oncology symptoms, preserving the UKONS safety floor, but showed relatively reduced precision and a conservative over-triage bias at lower-acuity margins, especially in the combined-therapy collective. These findings support a supervised, adjunctive role for LLMs, rather than autonomous deployment, pending prospective validation.Keywords
This publication has 17 references indexed in Scilit:
- Can ChatGPT Take My Call? evaluating AI in gynecologic oncology telephone triageGynecologic Oncology Reports, 2026
- Feasibility of telephone-based telemedicine for gynecologic oncology follow-up in Brazil’s public health system: a descriptive pilot studyClinics, 2026
- Diagnosis and Triage Performance of Contemporary Large Language Models on Short Clinical VignettesJournal of Medical Systems, 2025
- Making large language models into reliable physician assistantsNature Medicine, 2025
- GPT-4 assistance for improvement of physician performance on patient care tasks: a randomized controlled trialNature Medicine, 2025
- Toward expert-level medical question answering with large language modelsNature Medicine, 2025
- Evaluation of an established oncology triage hotline in a model of emergency department avoidance: assessing the UKONS triage tool and call outcomesSupportive Care in Cancer, 2023
- Large language models in medicineNature Medicine, 2023
- A qualitative study of patients' attitudes towards telemedicine for gynecologic cancer careGynecologic Oncology, 2022
- Quality of telephone-based cancer symptom management by nurses: a quality improvement projectSupportive Care in Cancer, 2020