Pearls and pitfalls of structured staging and reporting of rectal cancer on MRI: an international multireader study
Open Access
- 3 September 2023
- journal article
- research article
- Published by Oxford University Press (OUP) in British Journal of Radiology
- Vol. 96 (1150)
Abstract
Objectives: To investigate uniformity and pitfalls in structured radiological staging of rectal cancer. Methods: Twenty-one radiologists (12 countries) staged 75 rectal cancers on MRI using a structured reporting template. Interobserver agreement (IOA) was calculated as the percentage agreement between readers (categorical variables) and Krippendorff’s α (continuous variables). Agreement with an expert consensus served as a surrogate standard of reference to estimate diagnostic accuracy. Polychoric correlation coefficients were used to assess correlations between diagnostic confidence and accuracy (=agreement with expert consensus). Results: Uniformity to diagnose high-risk (≥cT3 ab) versus low-risk (≤cT3 cd) cT-stage, cN0 versus cN+, lateral nodes and tumour deposits, MRF and sphincter involvement, and solid versus mucinous tumours was high with IOA > 80% in the majority of cases (and >80% agreement with expert consensus). Results for assessing extramural vascular invasion, cT-stage (cT1-2/cT3/cT4a/cT4b), cN-stage (cN0/N1/N2), relation to the peritoneal reflection, extent of sphincter involvement (internal/intersphincteric/external) and morphology (solid/annular/semi-annular) were considerably poorer. IOA was high (α = 0.72–0.84) for tumour height/length and extramural invasion depth, but low for tumour-MRF distance and number of (suspicious) nodes (α = 0.05–0.55). There was a significant positive correlation between diagnostic confidence and accuracy (=agreement with expert consensus) (p < 0.001-p = 0.003). Conclusions: - Several staging items lacked sufficient reproducibility. - Results for cT- and N-staging g improved when using a dichotomized stratification. - Considering the significant correlation between diagnostic confidence and accuracy, a confidence level may be incorporated into structured reporting for specific items with low reproducibility. Advances in knowledge: Although structured reporting aims to achieve uniformity in reporting, several items lack sufficient reproducibility and might benefit from dichotomized assessment and incorporating confidence levels.Keywords
This publication has 25 references indexed in Scilit:
- Clinical lymph node staging in colorectal cancer; a flip of the coin?European Journal of Surgical Oncology, 2018
- Improving the Quality of MRI Reports of Preoperative Patients With Rectal Cancer: Effect of National Guidelines and Structured ReportingAmerican Journal of Roentgenology, 2018
- Correction to: Magnetic resonance imaging for clinical management of rectal cancer: Updated recommendations from the 2016 European Society of Gastrointestinal and Abdominal Radiology (ESGAR) consensus meetingEuropean Radiology, 2018
- Rectal cancer: ESMO Clinical Practice Guidelines for diagnosis, treatment and follow-upAnnals of Oncology, 2017
- Structured Reporting of Rectal Magnetic Resonance Imaging in Suspected Primary Rectal CancerInvestigative Radiology, 2017
- Preoperative High-resolution Magnetic Resonance Imaging Can Identify Good Prognosis Stage I, II, and III Rectal Cancer Best Managed by Surgery AloneAnnals of Surgery, 2011
- A Systematic Approach to the Interpretation of Preoperative Staging MRI for Rectal CancerAmerican Journal of Roentgenology, 2008
- Prognostic significance of magnetic resonance imaging-detected extramural vascular invasion in rectal cancerBritish Journal of Surgery, 2008
- Accuracy of magnetic resonance imaging in prediction of tumour-free resection margin in rectal cancer surgeryThe Lancet, 2001
- Testing the Normal Approximation and Minimal Sample Size Requirements of Weighted Kappa When the Number of Categories is LargeApplied Psychological Measurement, 1981