Image-based 3D surface approximation of the bladder using structure-from-motion for enhanced cystoscopy based on phantom data
Authors:
- 4 December 2017
- journal article
- research article
- Published by Walter de Gruyter GmbH in Biomedical Engineering / Biomedizinische Technik
- Vol. 63 (4) , 461-466
Abstract
Bladder cancer is likely to recur after resection. For this reason, bladder cancer survivors often undergo follow-up cystoscopy for years after treatment to look for bladder cancer recurrence. 3D modeling of the bladder could provide more reliable cystoscopic documentation by giving an overall picture of the organ and tumor positions. However, 3D reconstruction of the urinary bladder based on endoscopic images is challenging. This is due to the small field of view of the endoscope, considerable image distortion, and occlusion by urea, blood or particles. In this paper, we will demonstrate a method for the conversion of uncalibrated, monocular, endoscopic videos of the bladder into a 3D model using structure-from-motion (SfM). First of all, frames are extracted from video sequences. Distortions are then corrected in a calibration procedure. Finally, the 3D reconstruction algorithm generates a sparse surface approximation of the bladder lining based on the corrected frames. This method was tested using an endoscopic video of a phantom that mimics the rich structure of the bladder. The reconstructed 3D model covered a large part of the object, with an average reprojection error of 1.15 pixels and a relative accuracy of 99.4%.Keywords
This publication has 22 references indexed in Scilit:
- Optical techniques for 3D surface reconstruction in computer-assisted laparoscopic surgeryMedical Image Analysis, 2013
- Visual SLAM for Handheld Monocular EndoscopeIEEE Transactions on Medical Imaging, 2013
- Enhanced visualisation for minimally invasive surgeryInternational Journal of Computer Assisted Radiology and Surgery, 2011
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Possibilities and limitations of current stereo-endoscopySurgical Endoscopy, 2004
- Dry camera calibration for underwater applicationsMachine Vision and Applications, 2003
- Camera Model and Calibration Procedure for Oblique-Viewing Endoscope2003
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000
- Shape Reconstruction from an Endoscope Image by Shape from Shading Technique for a Point Light Source at the Projection CenterComputer Vision and Image Understanding, 1997
- Random sample consensusCommunications of the ACM, 1981