Visual SLAM for Handheld Monocular Endoscope
- 20 September 2013
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 33 (1) , 135-146
Abstract
Simultaneous localization and mapping (SLAM) methods provide real-time estimation of 3-D models from the sole input of a handheld camera, routinely in mobile robotics scenarios. Medical endoscopic sequences mimic a robotic scenario in which a handheld camera (monocular endoscope) moves along an unknown trajectory while observing an unknown cavity. However, the feasibility and accuracy of SLAM methods have not been extensively validated with human in vivo image sequences. In this work, we propose a monocular visual SLAM algorithm tailored to deal with medical image sequences in order to provide an up-to-scale 3-D map of the observed cavity and the endoscope trajectory at frame rate. The algorithm is validated over synthetic data and human in vivo sequences corresponding to 15 laparoscopic hernioplasties where accurate ground-truth distances are available. It can be concluded that the proposed procedure is: 1) noninvasive, because only a standard monocular endoscope and a surgical tool are used; 2) convenient, because only a hand-controlled exploratory motion is needed; 3) fast, because the algorithm provides the 3-D map and the trajectory in real time; 4) accurate, because it has been validated with respect to ground-truth; and 5) robust to inter-patient variability, because it has performed successfully over the validation sequences.Keywords
This publication has 27 references indexed in Scilit:
- Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgeryMedical Image Analysis, 2013
- A System for Video-Based Navigation for Endoscopic Endonasal Skull Base SurgeryIEEE Transactions on Medical Imaging, 2011
- Dense Surface Reconstruction for Enhanced Navigation in MIS2011
- Inverse Depth Parametrization for Monocular SLAMIEEE Transactions on Robotics, 2008
- Three-Dimensional Modeling From Endoscopic Video Using Geometric Constraints Via Feature PositioningIEEE Transactions on Biomedical Engineering, 2007
- Toward automated model building from video in computer-assisted diagnoses in colonoscopy2007
- Scale-invariant registration of monocular endoscopic images to CT-scans for sinus surgeryMedical Image Analysis, 2005
- Fusing points and lines for high performance tracking2005
- Flexible camera calibration by viewing a plane from unknown orientations1999
- Random sample consensusCommunications of the ACM, 1981