Observer agreement for small bowel ultrasound in Crohn’s disease: results from the METRIC trial
Authors:
- METRIC study investigatorsMIMETRIC study investigators
- Laura QuinnLQLaura Quinn
- Steve HalliganSHSteve Halligan
- Susan MallettSMSusan Mallett
- Stuart A. TaylorSTStuart A. Taylor
Open Access
- 10 February 2020
- journal article
- research article
- Published by Springer Nature in Abdominal Radiology
- Vol. 45 (10) , 3036-3045
Abstract
Purpose: To prospectively evaluate interobserver agreement for small bowel ultrasound (SBUS) in newly diagnosed and relapsing Crohn’s disease. Methods: A subset of patients recruited to a prospective trial comparing the diagnostic accuracy of MR enterography and SBUS underwent a second SBUS performed by one of a pool of six practitioners, who recorded the presence, activity and location of small bowel and colonic disease. Detailed segmental mural and extra-mural observations were also scored. Interobserver variability was expressed as percentage agreement with a construct reference standard, split by patient cohort, grouping disease as present or absent. Prevalence adjusted bias adjusted kappa (PABAK), and simple percentage agreement between practitioners, irrespective of the reference standard, were calculated. Results: Thirty-eight patients (11 new diagnosis, 27 relapse) were recruited from two sites. Overall percentage agreement for small bowel disease presence against the consensus reference was 82% (52–95% (95%CI)), kappa coefficient (κ) 0.64, (substantial agreement) for new diagnosis and 81%, κ 0.63 (substantial agreement) for the relapsing cohort. Agreement for colonic disease presence was 64%, κ 0.27 (fair agreement) in new diagnosis and 78%,κ 0.56 (moderate agreement) in the relapsing cohort. Simple agreement between practitioners was 84% and 87% for small bowel and colonic disease presence respectively. Practitioners agreed on small bowel disease activity in 24/27 (89%) where both identified disease. Kappa agreement for detailed mural observations ranged from κ 0.00 to 1.00. Conclusion: There is substantial practitioner agreement for small bowel disease presence in newly diagnosed and relapsing CD patients, supporting wider dissemination of enteric US.Keywords
Funding Information
- Health Technology Assessment Programme (10/68/01)
- UCLH Biomedical Research Centre
This publication has 17 references indexed in Scilit:
- Prospective cohort study of ultrasound-ultrasound and ultrasound-MR enterography agreement in the evaluation of pediatric small bowel Crohn diseasePediatric Radiology, 2015
- METRIC (MREnterography or ulTRasound in Crohn’s disease): a study protocol for a multicentre, non-randomised, single-arm, prospective comparison study of magnetic resonance enterography and small bowel ultrasound compared to a reference standard in those aged 16 and overBMC Gastroenterology, 2014
- Systematic review: the use of ultrasonography, computed tomography and magnetic resonance imaging for the diagnosis, assessment of activity and abdominal complications of Crohn’s diseaseAlimentary Pharmacology & Therapeutics, 2011
- US evaluation of patients affected by IBD: How to do it, methods and findingsEuropean Journal of Radiology, 2009
- Prevalence and clinical significance of sonographic evidence of mesenteric fat alterations in Crohnʼs diseaseInflammatory Bowel Diseases, 2008
- Reproducibility of bowel ultrasonography in the evaluation of Crohn's diseaseDigestive and Liver Disease, 2008
- Inflammatory Bowel Disease Diagnosed with US, MR, Scintigraphy, and CT: Meta-analysis of Prospective StudiesRadiology, 2008
- Crohn's disease: Comparison ofin vitroultrasonographic images and histologyScandinavian Journal of Gastroenterology, 2008
- Bowel ultrasound in Crohn's diseaseBest Practice & Research Clinical Gastroenterology, 2006
- Oral contrast enhanced bowel ultrasonography in the assessment of small intestine Crohn’s disease. A prospective comparison with conventional ultrasound, x ray studies, and ileocolonoscopyGut, 2004