Deep learning enabled classification of Mayo endoscopic subscore in patients with ulcerative colitis
- 16 October 2020
- journal article
- research article
- Published by Wolters Kluwer Health in European Journal of Gastroenterology & Hepatology
- Vol. 33 (5) , 645-649
Abstract
Objective: Previous reports of deep learning-assisted assessment of Mayo endoscopic subscore (MES) in ulcerative colitis have only explored the ability to distinguish disease remission (MES 0/1) from severe disease (MES 2/3) or inactive disease (MES 0) from active disease (MES 1–3). We sought to explore the utility of deep learning models in the automated grading of each individual MES in ulcerative colitis. Methods: In this retrospective study, a total of 777 representative still images of endoscopies from 777 patients with clinically active ulcerative colitis were graded using the MES by two physicians. Each image was assigned an MES of 1, 2, or 3. A 101-layer convolutional neural network model was trained and validated on 90% of the data, while 10% was left for a holdout test set. Model discrimination was assessed by calculating the area under the curve (AUC) of a receiver operating characteristic as well as standard measures of accuracy, specificity, sensitivity, positive predictive value (PPV), and negative predictive value (NPV). Results: In the holdout test set, the final model classified MES 3 disease with an AUC of 0.96, MES 2 disease with an AUC of 0.86, and MES 1 disease with an AUC 0.89. Overall accuracy was 77.2%. Across MES 1, 2, and 3, average specificity was 85.7%, average sensitivity was 72.4%, average PPV was 77.7%, and the average NPV was 87.0%. Conclusion: We have demonstrated a deep learning model was able to robustly classify individual grades of endoscopic disease severity among patients with ulcerative colitis.Keywords
This publication has 20 references indexed in Scilit:
- The Ulcerative Colitis Endoscopic Index of Severity More Accurately Reflects Clinical Outcomes and Long-term Prognosis than the Mayo Endoscopic ScoreJournal of Crohn's and Colitis, 2015
- Evaluation of the Risk of Relapse in Ulcerative Colitis According to the Degree of Mucosal Healing (Mayo 0 vs 1): A Longitudinal Cohort StudyJournal of Crohn's and Colitis, 2015
- An endoscopic Mayo score of 0 is associated with a lower risk of colectomy than a score of 1 in ulcerative colitisGut, 2014
- Challenges to the Design, Execution, and Analysis of Randomized Controlled Trials for Inflammatory Bowel DiseaseGastroenterology, 2012
- Mucosal healing restores normal health and quality of life in patients with inflammatory bowel diseaseEuropean Journal of Gastroenterology & Hepatology, 2012
- Developing an instrument to assess the endoscopic severity of ulcerative colitis: the Ulcerative Colitis Endoscopic Index of Severity (UCEIS)Gut, 2011
- Mucosal Healing in Inflammatory Bowel Disease: Results From a Norwegian Population-Based CohortGastroenterology, 2007
- Outcome measurement in clinical trials for ulcerative colitis: towards standardisationTrials, 2007
- A Review of Activity Indices and Efficacy End Points for Clinical Trials of Medical Therapy in Adults With Ulcerative ColitisGastroenterology, 2007
- Once-Daily, High-Concentration MMX Mesalamine in Active Ulcerative ColitisGastroenterology, 2007