Advanced Feature Extraction and Outlier Detection for 3D Biological/Biomedical Image Registration
- 1 July 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Biology and Bioinformatics
- Vol. 22 (4) , 1335-1346
Abstract
3D image registration is essential in computer vision, medical imaging, and robotics. By aligning images from different perspectives into a single coordinate system, this approach provides a consistent viewpoint for analysis. Using accurate image alignment, we may compare, evaluate, and integrate data from different contexts. This paper describes a new method to register 3D or z-stack microscopy and medical image. It uses a hybrid of traditional and deep learning methods for feature extraction and adaptive likelihood-based methods for finding outliers. The proposed method uses the Scale-invariant Feature Transform (SIFT) and the Residual Network with 50 layers (ResNet50) to extract effective features to obtain precise and accurate representations of image contents. The registration approach also relies on the adaptive Maximum Likelihood Estimation SAmple Consensus (MLESAC) method, which optimizes outlier detection and increases noise and distortion resistance to improve the efficacy of these combined extracted features. This concatenation approach demonstrates robustness, flexibility, and adaptability across a variety of imaging modalities, enabling the registration of complex images with higher precision. Results show that the proposed algorithm outperforms commonly used registration methods, including SIFT, KAZE, Oriented FAST and Rotated BRIEF (ORB), and also registration software tools such as bUnwarpJ, and TurboReg. The algorithm's effectiveness is evaluated in terms of Mutual Information (MI), Phase Congruency-Based (PCB), and Gradient-Based Metrics (GBM). These metrics are applied to two types of datasets, including a brain scan dataset and 3D serial sections of multiplex microscopy image datasets.Keywords
Funding Information
- National Institutes of Health (RF1MH130472)
- PI: Ostroff, Co-I: Nabavi, and Hamzehei's Cigna
- Computer Science and Engineering department at University of Connecticut
This publication has 53 references indexed in Scilit:
- Evaluation of Laparoscopic Performance with Alteration in Angle of VisionJournal of Endourology, 2006
- Mapping behaviorally relevant neural circuits with immediate-early gene expressionCurrent Opinion in Neurobiology, 2005
- Elastic Registration of Biological Images Using Vector-Spline RegularizationIEEE Transactions on Biomedical Engineering, 2005
- Anatomical diversity and age-related histological changes in the human right atrial posterolateral wallEP Europace, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Mutual-information-based registration of medical images: a surveyIEEE Transactions on Medical Imaging, 2003
- Medical image registrationPhysics in Medicine & Biology, 2001
- Immunohistochemical Localization of Lipocortin 1 in Rat Brain Is Sensitive to pH, Freezing, and DehydrationJournal of Histochemistry & Cytochemistry, 1997
- An interactive technique for three-dimensional image registration: validation for PET, SPECT, MRI and CT brain studies.1994
- Theory of edge detectionProceedings of the Royal Society of London. B. Biological Sciences, 1980