Time-of-flight-assisted Kinect camera-based people detection for intuitive human robot cooperation in the surgical operating room
- 14 November 2015
- journal article
- research article
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 11 (7) , 1329-1345
Abstract
Background Scene supervision is a major tool to make medical robots safer and more intuitive. The paper shows an approach to efficiently use 3D cameras within the surgical operating room to enable for safe human robot interaction and action perception. Additionally the presented approach aims to make 3D camera-based scene supervision more reliable and accurate. Methods A camera system composed of multiple Kinect and time-of-flight cameras has been designed, implemented and calibrated. Calibration and object detection as well as people tracking methods have been designed and evaluated. Results The camera system shows a good registration accuracy of 0.05 m. The tracking of humans is reliable and accurate and has been evaluated in an experimental setup using operating clothing. The robot detection shows an error of around 0.04 m. Conclusions The robustness and accuracy of the approach allow for an integration into modern operating room. The data output can be used directly for situation and workflow detection as well as collision avoidance.Keywords
Funding Information
- Seventh Framework Programme (270460)
- Seventh Framework Programme (248960)
This publication has 20 references indexed in Scilit:
- Calibration of Kinect-type RGB-D sensors for robotic applicationsFME Transactions, 2015
- Stereo Time-of-Flight with Constructive InterferenceIEEE Transactions on Pattern Analysis and Machine Intelligence, 2013
- Raven-II: An Open Platform for Surgical Robotics ResearchIEEE Transactions on Biomedical Engineering, 2012
- Real-time human pose recognition in parts from single depth images2011
- 3D is here: Point Cloud Library (PCL)2011
- The Intuitive/sup TM/ telesurgery system: overview and application2002
- A ROBOTIC SYSTEM FOR PERCUTANEOUS RENAL ACCESSJournal of Urology, 1997
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992
- Closed-form solution of absolute orientation using unit quaternionsJournal of the Optical Society of America A, 1987
- Random sample consensusCommunications of the ACM, 1981