A Vascular Feature Detection and Matching Method Based on Dual-Branch Fusion and Structure Enhancement
Open Access
Abstract
How to obtain internal cavity features and perform image matching is a great challenge for laparoscopic 3D reconstruction. This paper proposes a method for detecting and associating vascular features based on dual-branch weighted fusion vascular structure enhancement. Our proposed method is divided into three stages, including analyzing various types of minimally invasive surgery (MIS) images and designing a universal preprocessing framework to make our method generalized. We propose a Gaussian weighted fusion vascular structure enhancement algorithm using the dual-branch Frangi measure and MFAT (multiscale fractional anisotropic tensor) to address the structural measurement differences and uneven responses between venous vessels and microvessels, providing effective structural information for vascular feature extraction. We extract vascular features through dual-circle detection based on branch point characteristics, and introduce NMS (non-maximum suppression) to reduce feature point redundancy. We also calculate the ZSSD (zero sum of squared differences) and perform feature matching on the neighboring blocks of feature points extracted from the front and back frames. The experimental results show that the proposed method has an average accuracy and repeatability score of 0.7149 and 0.5612 in the Vivo data set, respectively. By evaluating the quantity, repeatability, and accuracy of feature detection, our method has more advantages and robustness than the existing methods.Keywords
Funding Information
- high-end foreign experts’ introduction program (G2022012010L, JD2023SJ19, LH2023F034, 2021, (2022A1020))
- Key Research and Development Plan Project of Heilongjiang (G2022012010L, JD2023SJ19, LH2023F034, 2021, (2022A1020))
- Natural Science Foundation of Heilongjiang Province (G2022012010L, JD2023SJ19, LH2023F034, 2021, (2022A1020))
- Reserved Leaders of Heilongjiang Provincial Leading Talent Echelon (G2022012010L, JD2023SJ19, LH2023F034, 2021, (2022A1020))
- Major Science and Technology Projects of Zhongshan City in 2022 (G2022012010L, JD2023SJ19, LH2023F034, 2021, (2022A1020))
This publication has 39 references indexed in Scilit:
- Accurate and robust feature description and dense point-wise matching based on feature fusion for endoscopic imagesComputerized Medical Imaging and Graphics, 2021
- Research and improvement of feature detection algorithm based on FASTRendiconti Lincei. Scienze Fisiche e Naturali, 2021
- Comparison of manual and semi-automatic registration in augmented reality image-guided liver surgery: a clinical feasibility studySurgical Endoscopy, 2020
- Endoscopic image feature matching via motion consensus and global bilateral regressionComputer Methods and Programs in Biomedicine, 2020
- Real-Time 3D Reconstruction of Colonoscopic Surfaces for Determining Missing Regions2019
- 2D and 3D Vascular Structures Enhancement via Multiscale Fractional Anisotropy Tensor2019
- The status of augmented reality in laparoscopic surgery as of 2016Medical Image Analysis, 2017
- Analysis of Distance/Similarity Measures for Diffusion Tensor Imaging2009
- Speeded-Up Robust Features (SURF)Computer Vision and Image Understanding, 2008
- Design and validation of a tool for neurite tracing and analysis in fluorescence microscopy imagesCytometry Part A, 2004