Distinguishing between Crohn’s disease and ulcerative colitis using deep learning models with interpretability
Open Access
- 25 January 2024
- journal article
- research article
- Published by Springer Nature in Pattern Analysis and Applications
- Vol. 27 (1) , 1-18
Abstract
Crohn’s disease and ulcerative colitis are two chronic diseases that cause inflammation in the tissues of the entire gastrointestinal tract and are described by the term inflammatory bowel disease. Gastroenterologists find it difficult to evaluate endoscopic images to recognise the characteristics of the two chronic diseases. Therefore, this work aims to build a dataset with images of Crohn’s disease and ulcerative colitis (collected from the public datasets LIMUC, HyperKvasir and CrohnIPI) and train deep learning models (five CNNs and six ViTs) to develop a tool capable of helping doctors to distinguish the type of inflammatory bowel disease. In addition, as these architectures will be too heavy to work in a hospital context, in this work, we are looking to use knowledge distillation to create lighter and simpler architectures with the same precision as the pre-trained architectures used in this study. During this process, it is important to evaluate and interpret the pre-trained architectures before the distillation process, and the architectures resulting from knowledge distillation to ensure that we can maintain performance and that the information learnt by both architectures are similar. It is concluded that is possible to reduce 25x the number of parameters while maintaining good performance and reducing the inference time by 5.32 s. Allied with this, through the interpretability of the models was concluded that both before and after the knowledge distillation are possible to identify ulcers, bleeding situations, and lesions caused by the inflammation of the disease.Keywords
Funding Information
- Instituto Politécnico de Coimbra
This publication has 46 references indexed in Scilit:
- An iterative oversampling approach for ordinal classification2019
- CNN-LSTM: Cascaded Framework For Brain Tumour Classification2018
- Classification of Mammography Images by Machine Learning Techniques2018
- Worldwide incidence and prevalence of inflammatory bowel disease in the 21st century: a systematic review of population-based studiesThe Lancet, 2017
- An Update on Inflammatory Bowel DiseasePrimary Care: Clinics in Office Practice, 2017
- Inflammatory Bowel Disease in Children and AdolescentsJAMA Pediatrics, 2015
- Inflammatory bowel disease: PathogenesisWorld Journal of Gastroenterology, 2014
- Max-Ordinal LearningIEEE Transactions on Neural Networks and Learning Systems, 2013
- Ordinal Data Classification Using Kernel Discriminant Analysis: A Comparison of Three Approaches2012
- Early Stopping — But When?2012