Deformable structure from motion by fusing visual and inertial measurement data
- 1 October 2012
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- No. 21530858,p. 4816-4821
Abstract
Accurate recovery of the 3D structure of a deforming surgical environment during minimally invasive surgery is important for intra-operative guidance. One key component of reliable reconstruction is accurate camera pose estimation, which is challenging for monocular cameras due to the paucity of reliable salient features, coupled with narrow baseline during surgical navigation. With recent advances in miniaturized MEMS sensors, the combination of inertial and vision sensing can provide increased robustness for camera pose estimation particularly for scenes involving tissue deformation. The aim of this work is to propose a robust framework for intra-operative free-form deformation recovery based on structure-from-motion. A novel adaptive Unscented Kalman Filter (UKF) parameterization scheme is proposed to fuse vision information with data from an Inertial Measurement Unit (IMU). The method is built on a compact scene representation scheme suitable for both surgical episode identification and instrument-tissue motion modelling. Detailed validation with both synthetic and phantom data is performed and results derived justify the potential clinical value of the technique.Keywords
This publication has 14 references indexed in Scilit:
- Two Efficient Solutions for Visual Odometry Using Directional CorrespondenceIEEE Transactions on Pattern Analysis and Machine Intelligence, 2011
- Robust embedded egomotion estimation2011
- Collaborative stereo2011
- An approach to ulta-tightly coupled data fusion for handheld input devices in robotic surgery2011
- Robust Real-Time Visual Odometry with a Single Camera and an IMU2011
- Content-Based Surgical Workflow Representation Using Probabilistic Motion Modeling2010
- Integration of Vision and Inertial Sensors for 3D Arm Motion Tracking in Home-based RehabilitationThe International Journal of Robotics Research, 2007
- Accurate Non-Iterative O(n) Solution to the PnP Problem2007
- An efficient solution to the five-point relative pose problemIEEE Transactions on Pattern Analysis and Machine Intelligence, 2004
- Vision and inertial sensor cooperation using gravity as a vertical referenceIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003