Surgical Gym: A high-performance GPU-based platform for reinforcement learning with surgical robots
Authors:
Top Cited Papers
- 13 May 2024
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 13354-13361
Abstract
Recent advances in robot-assisted surgery have resulted in progressively more precise, efficient, and minimally invasive procedures, sparking a new era of robotic surgical intervention. This enables doctors, in collaborative interaction with robots, to perform traditional or minimally invasive surgeries with improved outcomes through smaller incisions. Recent efforts are working toward making robotic surgery more autonomous which has the potential to reduce variability of surgical outcomes and reduce complication rates. Deep reinforcement learning methodologies offer scalable solutions for surgical automation, but their effectiveness relies on extensive data acquisition due to the absence of prior knowledge in successfully accomplishing tasks. Due to the intensive nature of simulated data collection, previous works have focused on making existing algorithms more efficient. In this work, we focus on making the simulator more efficient, making training data much more accessible than previously possible. We introduce Surgical Gym, an open-source high performance platform for surgical robot learning where both the physics simulation and reinforcement learning occur directly on the GPU. We demonstrate between 100-5000× faster training times compared with previous surgical learning platforms. The code is available at: https://github.com/SamuelSchmidgall/SurgicalGym.Keywords
All Related Versions
Funding Information
- National Science Foundation
This publication has 30 references indexed in Scilit:
- Real2Sim2Real: Self-Supervised Learning of Physical Single-Step Dynamic Actions for Planar Robot Casting2022
- SuPer Deep: A Surgical Perception Framework for Robotic Tissue Manipulation using Deep Learning for Feature Extraction2021
- Toward Synergic Learning for Autonomous Manipulation of Deformable Tissues via Surgical Robots: An Approximate Q-Learning Approach2020
- Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control2019
- A New Tensioning Method using Deep Reinforcement Learning for Surgical Pattern Cutting2019
- A V-REP Simulator for the da Vinci Research Kit Robotic Platform2018
- Multilateral surgical pattern cutting in 2D orthotropic gauze with deep reinforcement learning policies for tensioning2017
- An open-source research kit for the da Vinci® Surgical System2014
- The da Vinci Surgical System2010
- Development of a colon endoscope robot that adjusts its locomotion through the use of reinforcement learningInternational Journal of Computer Assisted Radiology and Surgery, 2010