ORBIT-Surgical: An Open-Simulation Framework for Learning Surgical Augmented Dexterity
Preprint
Abstract
Physics-based simulations have accelerated progress in robot learning for driving, manipulation, and locomotion. Yet, a fast, accurate, and robust surgical simulation environment remains a challenge. In this paper, we present ORBIT-Surgical, a physics-based surgical robot simulation framework with photorealistic rendering in NVIDIA Omniverse. We provide 14 benchmark surgical tasks for the da Vinci Research Kit (dVRK) and Smart Tissue Autonomous Robot (STAR) which represent common subtasks in surgical training. ORBIT-Surgical leverages GPU parallelization to train reinforcement learning and imitation learning algorithms to facilitate study of robot learning to augment human surgical skills. ORBIT-Surgical also facilitates realistic synthetic data generation for active perception tasks. We demonstrate ORBIT-Surgical sim-to-real transfer of learned policies onto a physical dVRK robot. Project website: orbit-surgical.github.ioKeywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Surgical Gym: A high-performance GPU-based platform for reinforcement learning with surgical robots2024
- DeXtreme: Transfer of Agile In-hand Manipulation from Simulation to Reality2023
- Orbit: A Unified Simulation Framework for Interactive Robot Learning EnvironmentsIEEE Robotics and Automation Letters, 2023
- DiSECt: a differentiable simulator for parameter inference and control in robotic cuttingAutonomous Robots, 2023
- Autonomy in Surgical RoboticsAnnual Review of Control, Robotics, and Autonomous Systems, 2021
- RLBench: The Robot Learning Benchmark & Learning EnvironmentIEEE Robotics and Automation Letters, 2020
- Learning ambidextrous robot grasping policiesScience Robotics, 2019
- Supervised autonomous robotic soft tissue surgeryScience Translational Medicine, 2016
- First experiences with the da Vinci™ operating robot in thoracic surgery☆European Journal of Cardio-Thoracic Surgery, 2004
- Technique of da vinci robot-assisted anatomic radical prostatectomyUrology, 2002