A Fast and Accurate Feature-Matching Algorithm for Minimally-Invasive Endoscopic Images
- 14 January 2013
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 32 (7) , 1201-1214
Abstract
The ability to find image similarities between two distinct endoscopic views is known as feature matching, and is essential in many robotic-assisted minimally-invasive surgery (MIS) applications. Differently from feature-tracking methods, feature matching does not make any restrictive assumption about the chronological order between the two images or about the organ motion, but first obtains a set of appearance-based image matches, and subsequently removes possible outliers based on geometric constraints. As a consequence, feature-matching algorithms can be used to recover the position of any image feature after unexpected camera events, such as complete occlusions, sudden endoscopic-camera retraction, or strong illumination changes. We introduce the hierarchical multi-affine (HMA) algorithm, which improves over existing feature-matching methods because of the larger number of image correspondences, the increased speed, and the higher accuracy and robustness. We tested HMA over a large (and annotated) dataset with more than 100 MIS image pairs obtained from real interventions, and containing many of the aforementioned sudden events. In all of these cases, HMA outperforms the existing state-of-the-art methods in terms of speed, accuracy, and robustness. In addition, HMA and the image database are made freely available on the internet.Keywords
This publication has 30 references indexed in Scilit:
- Augmented Reality Visualization During Laparoscopic Radical ProstatectomyJournal of Endourology, 2011
- Surgical VisionAnnals of Biomedical Engineering, 2011
- Vision-Based Navigation in Image-Guided InterventionsAnnual Review of Biomedical Engineering, 2011
- Image-Fusion, Augmented Reality, and Predictive Surgical NavigationUrologic Clinics of North America, 2009
- Augmented Reality During Robot-assisted Laparoscopic Partial Nephrectomy: Toward Real-Time 3D-CT to Stereoscopic Video RegistrationUrology, 2009
- 3D CT-Video Fusion for Image-Guided BronchoscopyComputerized Medical Imaging and Graphics, 2008
- An introduction to ROC analysisPattern Recognition Letters, 2006
- Monocular Model-Based 3D Tracking of Rigid Objects: A SurveyFoundations and Trends in Computer Graphics and Vision, 2005
- Complications of Laparoscopic Nephrectomy in 185 Patients: A Multi-Institutional ReviewJournal of Urology, 1995
- Random sample consensusCommunications of the ACM, 1981