Modeling of Surgical Procedures Using Statecharts for Semi-Autonomous Robotic Surgery
Open Access
- 6 September 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Robotics and Bionics
- Vol. 3 (4) , 888-899
Abstract
In this paper we propose a new methodology to model surgical procedures that is specifically tailored to semi-autonomous robotic surgery. We propose to use a restricted version of statecharts to merge the bottom-up approach, based on data-driven techniques (e.g., machine learning), with the top-down approach based on knowledge representation techniques. We consider medical knowledge about the procedure and sensing of the environment in two concurrent regions of the statecharts to facilitate re-usability and adaptability of the modules. Our approach allows producing a well defined procedural model exploiting the hierarchy capability of the statecharts, while machine learning modules act as soft sensors to trigger state transitions. Integrating data driven and prior knowledge techniques provides a robust, modular, flexible and re-configurable methodology to define a surgical procedure which is comprehensible by both humans and machines. We validate our approach on the three surgical phases of a Robot-Assisted Radical Prostatectomy (RARP) that directly involve the assistant surgeon: bladder mobilization, bladder neck transection, and vesicourethral anastomosis, all performed on synthetic manikins.Keywords
Funding Information
- European Research Council (ERC) through the European Unions Horizon 2020 Research and Innovation Programme (742671 (ARS))
- European Union’s Horizon 2020 Research and Innovation Programme (779813 (SARAS))
This publication has 30 references indexed in Scilit:
- Automatic data-driven real-time segmentation and recognition of surgical workflowInternational Journal of Computer Assisted Radiology and Surgery, 2016
- Semi-autonomous simulated brain tumor ablation with RAVENII Surgical Robot using behavior tree2015
- Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms2015
- Development of a Cognitive Robotic System for Simple Surgical TasksInternational Journal of Advanced Robotic Systems, 2015
- Surgical process modelling: a reviewInternational Journal of Computer Assisted Radiology and Surgery, 2013
- Hierarchical finite state machines for autonomous mobile systemsControl Engineering Practice, 2013
- Robotic-assisted laparoscopic radical prostatectomy: The Ohio State University techniqueJournal of Robotic Surgery, 2007
- Ontological and Practical Issues in Using a Description Logic to Represent Medical Concept Systems: Experience from GALEN2006
- The computational complexity of propositional STRIPS planningArtificial Intelligence, 1994
- On the Development of Reactive Systems1985