Human-in-the-Loop Embodied Intelligence With Interactive Simulation Environment for Surgical Robot Learning
- 8 June 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 8 (8) , 4441-4448
Abstract
Surgical robot automation has attracted increasing research interest over the past decade, expecting its potential to benefit surgeons, nurses and patients. Recently, the learning paradigm of embodied intelligence has demonstrated promising ability to learn good control policies for various complex tasks, where embodied AI simulators play an essential role to facilitate relevant research. However, existing open-sourced simulators for surgical robot are still not sufficiently supporting human interactions through physical input devices, which further limits effective investigations on how the human demonstrations would affect policy learning. In this work, we study human-in-the-loop embodied intelligence with a new interactive simulation platform for surgical robot learning. Specifically, we establish our platform based on our previously released SurRoL simulator with several new features co-developed to allow high-quality human interaction via an input device. We showcase the improvement of our simulation environment with the designed new features, and validate effectiveness of incorporating human factors in embodied intelligence through the use of human demonstrations and reinforcement learning as a representative example. Promising results are obtained in terms of learning efficiency. Lastly, five new surgical robot training tasks are developed and released, with which we hope to pave the way for future research on surgical embodied intelligence.Keywords
All Related Versions
Funding Information
- Hong Kong Research Grants Council TRS (T42-409/18-R)
- Hong Kong Innovation and Technology Commission (PRP/026/22FX)
- Multi-Scale Medical Robotics Center InnoHK (8312051)
- Research Fund from Cornerstone Robotics Ltd
This publication has 45 references indexed in Scilit:
- Multilateral surgical pattern cutting in 2D orthotropic gauze with deep reinforcement learning policies for tensioning2017
- Medical robotics—Regulatory, ethical, and legal considerations for increasing levels of autonomyScience Robotics, 2017
- Validation of the RobotiX Mentor Robotic Surgery SimulatorJournal of Endourology, 2016
- Fundamentals of robotic surgery: a course of basic robotic surgery skills based upon a 14-society consensus template of outcomes measures and curriculum developmentThe International Journal of Medical Robotics and Computer Assisted Surgery, 2013
- The virtual reality simulator dV-Trainer® is a valid assessment tool for robotic surgical skillsSurgical Endoscopy, 2012
- Face, Content, and Construct Validity of dV-Trainer, a Novel Virtual Reality Simulator for Robotic SurgeryUrology, 2009
- PID control system analysis, design, and technologyIEEE Transactions on Control Systems Technology, 2005
- The Panda3D graphics engineComputer, 2004
- Fast Phong shadingACM SIGGRAPH Computer Graphics, 1986
- Continuous Shading of Curved SurfacesIEEE Transactions on Computers, 1971