Renal surface reconstruction and segmentation for image-guided surgical navigation of laparoscopic partial nephrectomy
- 1 February 2023
- journal article
- research article
- Published by Springer Nature in Biomedical Engineering Letters
- Vol. 13 (2) , 165-174
Abstract
An unpredictable dynamic surgical environment makes it necessary to measure morphological information of target tissue real-time for laparoscopic image-guided navigation. The stereo vision method for intraoperative tissue 3D reconstruction has the most potential for clinical development benefiting from its high reconstruction accuracy and laparoscopy compatibility. However, existing stereo vision methods have difficulty in achieving high reconstruction accuracy in real time. Also, intraoperative tissue reconstruction results often contain complex background and instrument information that prevents clinical development for image-guided systems. Taking laparoscopic partial nephrectomy (LPN) as the research object, this paper realizes a real-time dense reconstruction and extraction of the kidney tissue surface. The central symmetrical Census based semi-global block stereo matching algorithm is proposed to generate a dense disparity map. A GPU-based pixel-by-pixel connectivity segmentation mechanism is designed to segment the renal tissue area. An in-vitro porcine heart, in-vivo porcine kidney and offline clinical LPN data were performed to evaluate the accuracy and effectiveness of our approach. The algorithm achieved a reconstruction accuracy of ± 2 mm with a real-time update rate of 21 fps for an HD image size of 960 × 540, and 91.0% target tissue segmentation accuracy even with surgical instrument occlusions. Experimental results have demonstrated that the proposed method could accurately reconstruct and extract renal surface in real-time in LPN. The measurement results can be used directly for image-guided systems. Our method provides a new way to measure geometric information of target tissue intraoperatively in laparoscopy surgery.Keywords
Funding Information
- Natural Science Foundation of China (No. 62173014)
- Natural Science Foundation of Beijing Municipality (No. L192057)
This publication has 38 references indexed in Scilit:
- Visual SLAM for Handheld Monocular EndoscopeIEEE Transactions on Medical Imaging, 2013
- Weighted Semi-Global Matching and Center-Symmetric Census Transform for Robust Driver Assistance2013
- Real-Time Dense Stereo Reconstruction Using Convex Optimisation with a Cost-Volume for Image-Guided Robotic Surgery2013
- Stereoscopic Scene Flow for Robotic Assisted Minimally Invasive Surgery2012
- Connected Component Labeling in CUDA2011
- Reconstruction of a 3D surface from video that is robust to missing data and outliers: Application to minimally invasive surgery using stereo and mono endoscopesMedical Image Analysis, 2010
- Real-Time Stereo Reconstruction in Robotically Assisted Minimally Invasive Surgery2010
- Augmented Reality During Robot-assisted Laparoscopic Partial Nephrectomy: Toward Real-Time 3D-CT to Stereoscopic Video RegistrationUrology, 2009
- Soft-Tissue Motion Tracking and Structure Estimation for Robotic Assisted MIS Procedures2005
- Minimally invasive (laparoscopic) surgerySurgical Endoscopy, 2002