Deep Learning–Based Real-Time Ureter Identification in Laparoscopic Colorectal Surgery
Top Cited Papers
- 3 July 2024
- journal article
- research article
- Published by Wolters Kluwer Health in Diseases of the Colon & Rectum
- Vol. 67 (10) , e1596-e1599
Abstract
BACKGROUND: Iatrogenic ureteral injury is a serious complication of abdominopelvic surgery. Identifying the ureters intraoperatively is essential to avoid iatrogenic ureteral injury. We developed a model that may minimize this complication. IMPACT OF INNOVATION: We applied a deep learning–based semantic segmentation algorithm to the ureter recognition task and developed a deep learning model called UreterNet. This study aimed to verify whether the ureters could be identified in videos of laparoscopic colorectal surgery. TECHNOLOGY, MATERIALS, AND METHODS: Semantic segmentation of the ureter area was performed using a convolutional neural network–based approach. Feature Pyramid Networks were used as the convolutional neural network architecture for semantic segmentation. Precision, recall, and the Dice coefficient were used as the evaluation metrics in this study. PRELIMINARY RESULTS: We created 14,069 annotated images from 304 videos, with 9537, 2266, and 2266 images in the training, validation, and test data sets, respectively. Concerning ureter recognition performance, the precision, recall, and Dice coefficient for the test data were 0.712, 0.722, and 0.716, respectively. Regarding the real-time performance on recorded videos, it took 71 milliseconds for UreterNet to infer all pixels corresponding to the ureter from a single still image and 143 milliseconds to output and display the inferred results as a segmentation mask on the laparoscopic monitor. CONCLUSIONS: UreterNet is a noninvasive method for identifying the ureter in videos of laparoscopic colorectal surgery and can potentially improve surgical safety. FUTURE DIRECTIONS: Although this deep learning model could lead to the development of an image-navigated surgical system, it is necessary to verify whether UreterNet reduces the occurrence of iatrogenic ureteral injury.Keywords
This publication has 12 references indexed in Scilit:
- Limited generalizability of single deep neural network for surgical instrument segmentation in different surgical environmentsScientific Reports, 2022
- Overview of the ethical guidelines for medical and biological research involving human subjects in JapanJapanese Journal of Clinical Oncology, 2022
- Intraureteral indocyanine green augments ureteral identification and avoidance during complex robotic‐assisted colorectal surgeryColorectal Disease, 2020
- Computer-assisted real-time automatic prostate segmentation during TaTME: a single-center feasibility studySurgical Endoscopy, 2020
- Current use and perspective of indocyanine green clearance in liver diseasesAnaesthesia Critical Care & Pain Medicine, 2016
- Iatrogenic ureteral injury in colorectal cancer surgery: a nationwide study comparing laparoscopic and open approachesSurgical Endoscopy, 2014
- Ureteral stenting in laparoscopic colorectal surgeryJournal of Surgical Research, 2014
- Ureteric injury: a challenging condition to diagnose and manageNature Reviews Urology, 2013
- Role of prophylactic ureteric stents in colorectal surgeryAsian Journal of Endoscopic Surgery, 2012
- An Initial Experience with Lighted Ureteral Catheters During Laparoscopic ColectomyJournal of Laparoendoscopic Surgery, 1994