Surgical step recognition in laparoscopic distal gastrectomy using artificial intelligence: a proof-of-concept study
Authors:
- 12 July 2024
- journal article
- research article
- Published by Springer Nature in Langenbeck's Archives of Surgery
- Vol. 409 (1) , 1-8
Abstract
Purpose Laparoscopic distal gastrectomy (LDG) is a difficult procedure for early career surgeons. Artificial intelligence (AI)-based surgical step recognition is crucial for establishing context-aware computer-aided surgery systems. In this study, we aimed to develop an automatic recognition model for LDG using AI and evaluate its performance. Methods Patients who underwent LDG at our institution in 2019 were included in this study. Surgical video data were classified into the following nine steps: (1) Port insertion; (2) Lymphadenectomy on the left side of the greater curvature; (3) Lymphadenectomy on the right side of the greater curvature; (4) Division of the duodenum; (5) Lymphadenectomy of the suprapancreatic area; (6) Lymphadenectomy on the lesser curvature; (7) Division of the stomach; (8) Reconstruction; and (9) From reconstruction to completion of surgery. Two gastric surgeons manually assigned all annotation labels. Convolutional neural network (CNN)-based image classification was further employed to identify surgical steps. Results The dataset comprised 40 LDG videos. Over 1,000,000 frames with annotated labels of the LDG steps were used to train the deep-learning model, with 30 and 10 surgical videos for training and validation, respectively. The classification accuracies of the developed models were precision, 0.88; recall, 0.87; F1 score, 0.88; and overall accuracy, 0.89. The inference speed of the proposed model was 32 ps. Conclusion The developed CNN model automatically recognized the LDG surgical process with relatively high accuracy. Adding more data to this model could provide a fundamental technology that could be used in the development of future surgical instruments.Keywords
This publication has 31 references indexed in Scilit:
- Artificial Intelligence in Surgery: Promises and PerilsAnnals of Surgery, 2018
- A High-Definition Video Teaching Module for Thyroidectomy SurgeryJournal of Surgical Education, 2018
- SV-RCNet: Workflow Recognition From Surgical Videos Using Recurrent Convolutional NetworkIEEE Transactions on Medical Imaging, 2017
- Video review program enhances resident training in laparoscopic inguinal hernia: a randomized blinded controlled trialSurgical Endoscopy, 2017
- Identification of technical errors and hazard zones in sleeve gastrectomy using OCHRASurgical Endoscopy, 2016
- Application of objective clinical human reliability analysis (OCHRA) in assessment of technical performance in laparoscopic rectal cancer surgeryTechniques in Coloproctology, 2016
- Automatic data-driven real-time segmentation and recognition of surgical workflowInternational Journal of Computer Assisted Radiology and Surgery, 2016
- Decreased Morbidity of Laparoscopic Distal Gastrectomy Compared With Open Distal Gastrectomy for Stage I Gastric CancerAnnals of Surgery, 2016
- Observational clinical human reliability analysis (OCHRA) for competency assessment in laparoscopic colorectal surgery at the specialist levelSurgical Endoscopy, 2011
- Laparoscopy-assisted Billroth I gastrectomy.1994