Surgical Phase Recognition in Inguinal Hernia Repair—AI-Based Confirmatory Baseline and Exploration of Competitive Models
Authors:
- Chengbo ZangCZChengbo Zang
- Mehmet Kerem TurkcanMTMehmet Kerem Turkcan
- Sanjeev NarasimhanSNSanjeev Narasimhan
- Yuqing CaoYCYuqing Cao
- Kaan YaraliKYKaan Yarali
- Zixuan XiangZXZixuan Xiang
- Skyler SzotSSSkyler Szot
- Feroz AhmadFAFeroz Ahmad
- Sarah ChoksiSCSarah Choksi
- Daniel P. BitnerDBDaniel P. Bitner
- Filippo FilicoriFFFilippo Filicori
- Zoran KosticZKZoran Kostic
Open Access
- 27 May 2023
- journal article
- research article
- Published by MDPI AG in Bioengineering
- Vol. 10 (6) , 654
Abstract
Video-recorded robotic-assisted surgeries allow the use of automated computer vision and artificial intelligence/deep learning methods for quality assessment and workflow analysis in surgical phase recognition. We considered a dataset of 209 videos of robotic-assisted laparoscopic inguinal hernia repair (RALIHR) collected from 8 surgeons, defined rigorous ground-truth annotation rules, then pre-processed and annotated the videos. We deployed seven deep learning models to establish the baseline accuracy for surgical phase recognition and explored four advanced architectures. For rapid execution of the studies, we initially engaged three dozen MS-level engineering students in a competitive classroom setting, followed by focused research. We unified the data processing pipeline in a confirmatory study, and explored a number of scenarios which differ in how the DL networks were trained and evaluated. For the scenario with 21 validation videos of all surgeons, the Video Swin Transformer model achieved ~0.85 validation accuracy, and the Perceiver IO model achieved ~0.84. Our studies affirm the necessity of close collaborative research between medical experts and engineers for developing automated surgical phase recognition models deployable in clinical settings.Keywords
Funding Information
- SAGES 2020 Robotics
- Hugoton Foundation
This publication has 26 references indexed in Scilit:
- Automated operative phase identification in peroral endoscopic myotomySurgical Endoscopy, 2020
- Real-time automatic surgical phase recognition in laparoscopic sigmoidectomy using the convolutional neural network-based deep learning approachSurgical Endoscopy, 2019
- Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based LocalizationInternational Journal of Computer Vision, 2019
- Computer Vision Analysis of Intraoperative VideoAnnals of Surgery, 2019
- Artificial Intelligence in Surgery: Promises and PerilsAnnals of Surgery, 2018
- Grad-CAM++: Generalized Gradient-Based Visual Explanations for Deep Convolutional Networks2018
- SV-RCNet: Workflow Recognition From Surgical Videos Using Recurrent Convolutional NetworkIEEE Transactions on Medical Imaging, 2017
- ImageNet classification with deep convolutional neural networksCommunications of the ACM, 2017
- EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic VideosIEEE Transactions on Medical Imaging, 2016
- Deep Residual Learning for Image Recognition2016