Learning from Demonstrations for Autonomous Soft-tissue Retraction
Authors:
- Diego Dall'ALbaDDDiego Dall'ALba
- 17 November 2021
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-7
Abstract
The current research focus in Robot-Assisted Minimally Invasive Surgery (RAMIS) is directed towards increasing the level of robot autonomy, to place surgeons in a supervisory position. Although Learning from Demonstrations (LfD) approaches are among the preferred ways for an autonomous surgical system to learn expert gestures, they require a high number of demonstrations and show poor generalization to the variable conditions of the surgical environment. In this work, we propose an LfD methodology based on Generative Adversarial Imitation Learning (GAIL) that is built on a Deep Reinforcement Learning (DRL) setting. GAIL combines generative adversarial networks to learn the distribution of expert trajectories with a DRL setting to ensure generalisation of trajectories providing human-like behaviour. We consider automation of tissue retraction, a common RAMIS task that involves soft tissues manipulation to expose a region of interest. In our proposed methodology, a small set of expert trajectories can be acquired through the da Vinci Research Kit (dVRK) and used to train the proposed LfD method inside a simulated environment. Results indicate that our methodology can accomplish the tissue retraction task with human-like behaviour while being more sample-efficient than the baseline DRL method. Towards the end, we show that the learnt policies can be successfully transferred to the real robotic platform and deployed for soft tissue retraction on a synthetic phantom.Keywords
All Related Versions
This publication has 19 references indexed in Scilit:
- End-to-End Safe Reinforcement Learning through Barrier Functions for Safety-Critical Continuous Control TasksProceedings of the AAAI Conference on Artificial Intelligence, 2019
- Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control2019
- Medical Technologies and Challenges of Robot-Assisted Minimally Invasive Intervention and DiagnosticsAnnual Review of Control, Robotics, and Autonomous Systems, 2018
- Surgical subtask automation — Soft tissue retraction2018
- Imitation LearningACM Computing Surveys, 2017
- Online Trajectory Planning and Force Control for Automation of Surgical TasksIEEE Transactions on Automation Science and Engineering, 2017
- Learning by observation for surgical subtasks: Multilateral cutting of 3D viscoelastic and 2D Orthotropic Tissue Phantoms2015
- A case study of trajectory transfer through non-rigid registration for a simplified suturing scenario2013
- Motion generation of robotic surgical tasks: Learning from expert demonstrations2010
- Toward automated tissue retraction in robot-assisted surgery2010