A Deep Metric for Multimodal Registration
Preprint
Abstract
Multimodal registration is a challenging problem in medical imaging due the high variability of tissue appearance under different imaging modalities. The crucial component here is the choice of the right similarity measure. We make a step towards a general learning-based solution that can be adapted to specific situations and present a metric based on a convolutional neural network. Our network can be trained from scratch even from a few aligned image pairs. The metric is validated on intersubject deformable registration on a dataset different from the one used for training, demonstrating good generalization. In this task, we outperform mutual information by a significant margin.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- Deep similarity learning for multimodal medical imagesComputer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, 2016
- Learning to compare image patches via convolutional neural networks2015
- Deformable Medical Image Registration: A SurveyIEEE Transactions on Medical Imaging, 2013
- Robust Multimodal Dictionary Learning2013
- MIND: Modality independent neighbourhood descriptor for multi-modal deformable registrationMedical Image Analysis, 2012
- Magnetic resonance imaging of the newborn brain: Manual segmentation of labelled atlases in term-born and preterm infantsNeuroImage, 2012
- Deformable Medical Image Registration: Setting the State of the Art with Discrete MethodsAnnual Review of Biomedical Engineering, 2011
- Boosted metric learning for 3D multi-modal deformable registration2011
- Learning Based Non-rigid Multi-modal Image Registration Using Kullback-Leibler DivergenceLecture Notes in Computer Science, 2005
- Nonrigid multimodality image registration2001