International multispecialty expert physician preoperative identification of extranodal extension in patients with oropharyngeal cancer using computed tomography: Prospective blinded human inter‐observer performance evaluation
Abstract
Background: Pathologic extranodal extension (pENE) is a crucial prognostic factor in oropharyngeal cancer (OPC), but determining pENE from imaging has high inter‐observer variability. The role of clinician specialty in the accuracy of imaging‐detected extranodal extension (iENE) remains unclear. The purpose of this study is to assess the influence of clinician specialty on the accuracy of preoperative iENE detection in human papillomavirus (HPV)‐positive OPC using computed tomography (CT) imaging.Methods: This prospective observational study evaluated pretherapy CT images from 24 HPV‐positive OPC patients (30 scans, including duplicates). Thirty‐four expert observers (11 radiologists, 12 surgeons, 11 radiation oncologists) assessed iENE and reported radiologic criteria and confidence. Ground‐truth pENE status was confirmed pathologically. Accuracy, sensitivity, specificity, area under the receiver operating characteristic curve, and Brier scores were compared across specialties. Logistic regression determined significant predictors of pENE, whereas Fleiss’ kappa measured interobserver agreement.Results: Median accuracy was 0.57 (95% CI, 0.39–0.73), with no specialty showing performance beyond chance (median area under the receiver operating characteristic curve, 0.64). Minor differences were noted: surgeons had lower Brier scores (0.26 vs. 0.33, p < .01) and higher sensitivity (0.69 vs. 0.48) compared to radiologists and oncologists. Predictive signs included indistinct capsular contour and nodal necrosis. Interobserver agreement was weak (κ < 0.6).Conclusions: Diagnostic performance for iENE on CT in HPV‐positive OPC remains poor across specialties, with high variability and low accuracy. These findings highlight the need for automated systems or improved imaging methods to enhance iENE assessments.Keywords
Funding Information
- National Cancer Institute (P30CA016672)
This publication has 43 references indexed in Scilit:
- Optimized decision support for selection of transoral robotic surgery or (chemo)radiation therapy based on posttreatment swallowing toxicityCancer Medicine, 2022
- Correlation between radiologic and pathologic extranodal extension in HPV‐associated oropharyngeal cancer: Systematic reviewHead & Neck, 2022
- Augmenting inter‐rater concordance of radiologic extranodal extension in HPV ‐positive oropharyngeal carcinoma: A multicenter studyHead & Neck, 2022
- Assessment of Toxic Effects and Survival in Treatment Deescalation With Radiotherapy vs Transoral Surgery for HPV-Associated Oropharyngeal Squamous Cell CarcinomaJAMA Oncology, 2022
- Risk of Pathologic Extranodal Extension and Other Adverse Features After Transoral Robotic Surgery in Patients With HPV-Positive Oropharynx CancerJAMA Otolaryngology–Head & Neck Surgery, 2021
- Predictive value of computed tomography in identifying extranodal extension in human papillomavirus‐positive versus human papillomavirus‐negative head and neck cancerHead & Neck, 2020
- Computed tomography performance in predicting extranodal extension in HPV‐positive oropharynx cancerThe Laryngoscope, 2019
- The impact of the multidisciplinary tumor board on head and neck cancer outcomesThe Laryngoscope, 2019
- Accuracy of computed tomography to predict extracapsular spread in p16‐positive squamous cell carcinomaThe Laryngoscope, 2015
- Observer variation in the histopathologic assessment of extranodal tumor spread in lymph node metastases in the neckHead & Neck, 2011