Tool-tissue force segmentation and pattern recognition for evaluating neurosurgical performance
Open Access
- 13 June 2023
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 13 (1) , 1-10
Abstract
Surgical data quantification and comprehension expose subtle patterns in tasks and performance. Enabling surgical devices with artificial intelligence provides surgeons with personalized and objective performance evaluation: a virtual surgical assist. Here we present machine learning models developed for analyzing surgical finesse using tool-tissue interaction force data in surgical dissection obtained from a sensorized bipolar forceps. Data modeling was performed using 50 neurosurgery procedures that involved elective surgical treatment for various intracranial pathologies. The data collection was conducted by 13 surgeons of varying experience levels using sensorized bipolar forceps, SmartForceps System. The machine learning algorithm constituted design and implementation for three primary purposes, i.e., force profile segmentation for obtaining active periods of tool utilization using T-U-Net, surgical skill classification into Expert and Novice, and surgical task recognition into two primary categories of Coagulation versus non-Coagulation using FTFIT deep learning architectures. The final report to surgeon was a dashboard containing recognized segments of force application categorized into skill and task classes along with performance metrics charts compared to expert level surgeons. Operating room data recording of > 161 h containing approximately 3.6 K periods of tool operation was utilized. The modeling resulted in Weighted F1-score = 0.95 and AUC = 0.99 for force profile segmentation using T-U-Net, Weighted F1-score = 0.71 and AUC = 0.81 for surgical skill classification, and Weighted F1-score = 0.82 and AUC = 0.89 for surgical task recognition using a subset of hand-crafted features augmented to FTFIT neural network. This study delivers a novel machine learning module in a cloud, enabling an end-to-end platform for intraoperative surgical performance monitoring and evaluation. Accessed through a secure application for professional connectivity, a paradigm for data-driven learning is established.Keywords
Funding Information
- Canadian Institutes of Health Research (390405)
- German Canadian Centre for Innovation and Research
This publication has 39 references indexed in Scilit:
- A Force-Sensing Bipolar Forceps to Quantify Tool–Tissue Interaction Forces in MicrosurgeryIEEE/ASME Transactions on Mechatronics, 2016
- Task-Level vs. Segment-Level Quantitative Metrics for Surgical Skill AssessmentJournal of Surgical Education, 2016
- Quantification of Forces During a Neurosurgical Procedure: A Pilot StudyWorld Neurosurgery, 2015
- Objective assessment of robotic surgical skill using instrument contact vibrationsSurgical Endoscopy, 2015
- Cognitive skills assessment during robot‐assisted surgery: separating the wheat from the chaffBJU International, 2014
- Surgical Skill and Complication Rates after Bariatric SurgeryNew England Journal of Medicine, 2013
- Statistical modeling and recognition of surgical workflowMedical Image Analysis, 2012
- The Benefit of Force Feedback in Surgery: Examination of Blunt DissectionPRESENCE: Virtual and Augmented Reality, 2007
- Force Feedback Plays a Significant Role in Minimally Invasive SurgeryAnnals of Surgery, 2005
- Markov modeling of minimally invasive surgery based on tool/tissue interaction and force/torque signatures for evaluating surgical skillsIEEE Transactions on Biomedical Engineering, 2001