CB‐HRNet: A Class‐Balanced High‐Resolution Network for the evaluation of endoscopic activity in patients with ulcerative colitis
Open Access
- 15 May 2023
- journal article
- research article
- Published by Wiley in Clinical and Translational Science
- Vol. 16 (8) , 1421-1430
Abstract
Endoscopic evaluation is the key to the management of ulcerative colitis (UC). However, there is interobserver variability in interpreting endoscopic images among gastroenterologists. Furthermore, it is time‐consuming. Convolutional neural networks (CNNs) can help overcome these obstacles and has yielded preliminary positive results. We aimed to develop a new CNN‐based algorithm to improve the performance for evaluation tasks of endoscopic images in patients with UC. A total of 12,163 endoscopic images from 308 patients with UC were collected from January 2014 to December 2021. The training set and test set images were randomly divided into 37,515 and 3191 after excluding possible interference and data augmentation. Mayo Endoscopic Subscores (MES) were predicted by different CNN‐based models with different loss functions. Their performances were evaluated by several metrics. After comparing the results of different CNN‐based models with different loss functions, High‐Resolution Network with Class‐Balanced Loss achieved the best performances in all MES classification subtasks. It was especially great at determining endoscopic remission in UC, which achieved a high accuracy of 95.07% and good performances in other evaluation metrics with sensitivity 92.87%, specificity 95.41%, kappa coefficient 0.8836, positive predictive value 93.44%, negative predictive value 95.00% and area value under the receiver operating characteristic curve 0.9834, respectively. In conclusion, we proposed a new CNN‐based algorithm, Class‐Balanced High‐Resolution Network (CB‐HRNet), to evaluate endoscopic activity of UC with excellent performance. Besides, we made an open‐source dataset and it can be a new benchmark in the task of MES classification.Keywords
Funding Information
- National Natural Science Foundation of China (81770528, 81974063, 81800493)
This publication has 31 references indexed in Scilit:
- Endoscopic scoring indices for evaluation of disease activity in ulcerative colitisCochrane Database of Systematic Reviews, 2018
- Early histological findings may predict the clinical phenotype in Crohn’s colitisUnited European Gastroenterology Journal, 2017
- Aggregated Residual Transformations for Deep Neural Networks2017
- Dermatologist-level classification of skin cancer with deep neural networksNature, 2017
- Deep Residual Learning for Image Recognition2016
- Performance of Common Disease Activity Markers as a Reflection of Inflammatory Burden in Ulcerative ColitisInflammatory Bowel Diseases, 2016
- Deep learningNature, 2015
- The Role of Centralized Reading of Endoscopy in a Randomized Controlled Trial of Mesalamine for Ulcerative ColitisGastroenterology, 2013
- Developing an instrument to assess the endoscopic severity of ulcerative colitis: the Ulcerative Colitis Endoscopic Index of Severity (UCEIS)Gut, 2011
- Coated Oral 5-Aminosalicylic Acid Therapy for Mildly to Moderately Active Ulcerative ColitisNew England Journal of Medicine, 1987