Safe Reinforcement Learning using Formal Verification for Tissue Retraction in Autonomous Robotic-Assisted Surgery
Authors:
- Diego Dall'ALbaDDDiego Dall'ALba
- 27 September 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 4025-4031
Abstract
Deep Reinforcement Learning (DRL) is a viable solution for automating repetitive surgical subtasks due to its ability to learn complex behaviours in a dynamic environment. This task automation could lead to reduced surgeon’s cognitive workload, increased precision in critical aspects of the surgery, and fewer patient-related complications. However, current DRL methods do not guarantee any safety criteria as they maximise cumulative rewards without considering the risks associated with the actions performed. Due to this limitation, the application of DRL in the safety-critical paradigm of robot-assisted Minimally Invasive Surgery (MIS) has been constrained. In this work, we introduce a Safe-DRL framework that incorporates safety constraints for the automation of surgical subtasks via DRL training. We validate our approach in a virtual scene that replicates a tissue retraction task commonly occurring in multiple phases of an MIS. Furthermore, to evaluate the safe behaviour of the robotic arms, we formulate a formal verification tool for DRL methods that provides the probability of unsafe configurations. Our results indicate that a formal analysis guarantees safety with high confidence such that the robotic instruments operate within the safe workspace and avoid hazardous interaction with other anatomical structures.Keywords
All Related Versions
This publication has 16 references indexed in Scilit:
- Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control2019
- Manipulating Soft Tissues by Deep Reinforcement Learning for Autonomous Robotic Surgery2019
- Surgical subtask automation — Soft tissue retraction2018
- Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks2017
- Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collectionThe International Journal of Robotics Research, 2017
- Multilateral surgical pattern cutting in 2D orthotropic gauze with deep reinforcement learning policies for tensioning2017
- Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms2015
- Current and future practices in surgical retractionThe Surgeon, 2013
- Empirical evaluation methods for multiobjective reinforcement learning algorithmsMachine Learning, 2010
- Toward automated tissue retraction in robot-assisted surgery2010