Development of a Novel Real-Time Computer-Assisted Colonoscopy Diagnostic Tool for Colorectal Neoplasia and Cancer to Enable Personalized Patient Management: Protocol for a Multicenter Proof-of-Concept Study
Authors:
- Olaolu OlabintanOOOlaolu Olabintan
- Angelo BrunoriABAngelo Brunori
- Natalie HalvorsenNHNatalie Halvorsen
- Nils AndersenNANils Andersen
- Verónica G ZubiaurreVZVerónica G Zubiaurre
- Ina Dam PedersenIPIna Dam Pedersen
- Alessandro D’APranoADAlessandro D’APrano
- Johnathan SunJSJohnathan Sun
- Ahmed Ghazwan WaraichAWAhmed Ghazwan Waraich
Open Access
- 21 October 2026
- journal article
- research article
- Published by JMIR Publications Inc. in JMIR Research Protocols
- Vol. 15, e77277
Abstract
Background: Accurate real-time classification of colorectal polyps during colonoscopy is essential for risk stratification, therapeutic decision-making, and surveillance planning, with important implications for colorectal cancer prevention, health care costs, and patient burden. Despite advances in optical diagnosis techniques, including virtual chromoendoscopy and magnification, widespread adoption remains limited because of high operator dependency and variable diagnostic accuracy. Existing computer-assisted diagnosis (CADx) systems predominantly provide binary classification of colorectal lesions, thereby constraining their clinical utility for nuanced endoscopic decision-making. Objective: This study aims to develop and validate a real-time, multiclass AI-based CADx system capable of classifying colorectal lesions into 5 categories: nonneoplastic lesions, low-grade adenomas, high-grade adenomas, sessile serrated lesions (SSL), and invasive colorectal cancer. Methods: This multicenter international study consists of 2 phases: model development and proof-of-concept validation. During the model development phase, a large, diverse dataset of >17,000 deidentified endoscopic images and video frames will be prospectively collected from 8 European centers and 1 Japanese center, capturing a broad spectrum of lesion types and patient demographics. A semisupervised learning framework using contrastive representation learning (SimCLR [simple framework for contrastive learning of visual representations]) will be used to leverage both labeled and unlabeled data, enhancing feature extraction and classification performance. Expert consensus annotation will be used for labeled data. Lesion localization will be supported by an integrated computer-assisted detection (CADe) module, while model interpretability will be facilitated through gradient-weighted class activation mapping (Grad-CAM). Proof-of-concept validation will be conducted using 250 previously unseen lesion images that will be independently assessed by expert endoscopists. The primary outcome is multiclass diagnostic accuracy, with a predefined target accuracy threshold of 85%, alongside sensitivity and specificity for invasive cancer detection. Secondary outcomes include interobserver agreement, performance across demographic and lesion subgroups, and a qualitative analysis of misclassification patterns. All data will be securely managed within a REDCap database, with strict deidentification protocols and plans to generate an open-access research resource. Results: Ethics approval has been obtained at all participating centres. Data transfer agreements have been executed by the majority of collaborating sites, with de-identified polyp images and videos currently being uploaded to a secure central database. Conclusions: This study aims to deliver a clinically applicable, real-time multiclass CADx system that extends beyond current binary AI models and supports more granular, personalized endoscopic decision-making. By integrating semisupervised learning, diverse international data, and explainable AI techniques, this approach has the potential to substantially advance the methodological foundations and clinical utility of AI-assisted optical diagnosis in routine colonoscopy, contributing to improved colorectal cancer prevention and patient care.Keywords
This publication has 24 references indexed in Scilit:
- Robust and data-efficient generalization of self-supervised machine learning for diagnostic imagingNature Biomedical Engineering, 2023
- Development of a computer-aided detection system for colonoscopy and a publicly accessible large colonoscopy video database (with video)Gastrointestinal Endoscopy, 2021
- Artificial Intelligence System to Determine Risk of T1 Colorectal Cancer Metastasis to Lymph NodeGastroenterology, 2021
- Artificial intelligence in colonoscopy ‐ Now on the market. What's next?Journal of Gastroenterology and Hepatology, 2020
- Post-polypectomy colonoscopy surveillance: European Society of Gastrointestinal Endoscopy (ESGE) Guideline – Update 2020Endoscopy, 2020
- Recommendations for Follow-Up After Colonoscopy and Polypectomy: A Consensus Update by the US Multi-Society Task Force on Colorectal CancerGastroenterology, 2020
- What Is the Hang-Up With Optical Diagnosis of Diminutive Colorectal Polyps?Clinical Gastroenterology and Hepatology, 2019
- Increasing Rates of Surgery for Patients With Nonmalignant Colorectal Polyps in the United StatesGastroenterology, 2018
- Characterization of Colorectal Lesions Using a Computer-Aided Diagnostic System for Narrow-Band Imaging EndocytoscopyGastroenterology, 2016
- A Resect and Discard Strategy Would Improve Cost-Effectiveness of Colorectal Cancer ScreeningClinical Gastroenterology and Hepatology, 2010