Towards Realtime Multimodal Fusion for Image-Guided Interventions Using Self-similarities
- 1 January 2013
- book chapter
- Published by Springer Nature
- Vol. 16, 187-194
Abstract
Image-guided interventions often rely on deformable multi-modal registration to align pre-treatment and intra-operative scans. There are a number of requirements for automated image registration for this task, such as a robust similarity metric for scans of different modalities with different noise distributions and contrast, an efficient optimisation of the cost function to enable fast registration for this time-sensitive application, and an insensitive choice of registration parameters to avoid delays in practical clinical use. In this work, we build upon the concept of structural image representation for multi-modal similarity. Discriminative descriptors are densely extracted for the multi-modal scans based on the “self-similarity context”. An efficient quantised representation is derived that enables very fast computation of point-wise distances between descriptors. A symmetric multi-scale discrete optimisation with diffusion regularisation is used to find smooth transformations. The method is evaluated for the registration of 3D ultrasound and MRI brain scans for neurosurgery and demonstrates a significantly reduced registration error (on average 2.1 mm) compared to commonly used similarity metrics and computation times of less than 30 seconds per 3D registration.Keywords
This publication has 19 references indexed in Scilit:
- MRF-Based Deformable Registration and Ventilation Estimation of Lung CTIEEE Transactions on Medical Imaging, 2013
- MIND: Modality independent neighbourhood descriptor for multi-modal deformable registrationMedical Image Analysis, 2012
- Multi-Modal Image Registration Based on Gradient Orientations of Minimal UncertaintyIEEE Transactions on Medical Imaging, 2012
- Globally Optimal Deformable Registration on a Minimum Spanning Tree Using Dense Displacement Sampling2012
- An integrated approach to segmentation and nonrigid registration for application in image-guided pelvic radiotherapyMedical Image Analysis, 2011
- Learning Spatial Context: Using Stuff to Find Things2008
- Evaluation of Optimization Methods for Nonrigid Medical Image Registration Using Mutual Information and B-SplinesIEEE Transactions on Image Processing, 2007
- Pictorial Structures for Object RecognitionInternational Journal of Computer Vision, 2005
- Automatic Non-linear MRI-Ultrasound Registration for the Correction of Intra-operative Brain Deformations2001
- Multimodality image registration by maximization of mutual informationIEEE Transactions on Medical Imaging, 1997