Human-Machine Collaborative surgery using learned models
Authors:
- 1 May 2011
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 10504729,p. 5285-5292
Abstract
In the future of surgery, tele-operated robotic assistants will offer the possibility of performing certain commonly occurring tasks autonomously. Using a natural division of tasks into subtasks, we propose a novel surgical Human-Machine Collaborative (HMC) system in which portions of a surgical task are performed autonomously under complete surgeon's control, and other portions manually. Our system automatically identifies the completion of a manual subtask, seamlessly executes the next automated task, and then returns control back to the surgeon. Our approach is based on learning from demonstration. It uses Hidden Markov Models for the recognition of task completion and temporal curve averaging for learning the executed motions. We demonstrate our approach using a da Vinci tele-surgical robot. We show on two illustrative tasks where such human-machine collaboration is intuitive that automated control improves the usage of the master manipulator workspace. Because such a system does not limit the traditional use of the robot, but merely enhances its capabilities while leaving full control to the surgeon, it provides a safe and acceptable solution for surgical performance enhancement.Keywords
This publication has 16 references indexed in Scilit:
- Workflow monitoring based on 3D motion features2009
- Mouth gesture and voice command based robot command interface2009
- Recognition of risk situations based on endoscopic instrument tracking and knowledge based situation modeling2008
- Development and evaluation of the second version of scrub nurse robot (SNR) for endoscopic and laparoscopic surgery2007
- Averaging QuaternionsJournal of Guidance, Control, and Dynamics, 2007
- A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks2006
- Towards endoscopic augmented reality for robotically assisted minimally invasive cardiac surgery2001
- Alignment of curves by dynamic time warpingThe Annals of Statistics, 1997
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Dynamic programming algorithm optimization for spoken word recognitionIEEE Transactions on Acoustics, Speech, and Signal Processing, 1978