Recurrent Registration Neural Networks for Deformable Image Registration
Preprint
Abstract
Parametric spatial transformation models have been successfully applied to image registration tasks. In such models, the transformation of interest is parameterized by a fixed set of basis functions as for example B-splines. Each basis function is located on a fixed regular grid position among the image domain, because the transformation of interest is not known in advance. As a consequence, not all basis functions will necessarily contribute to the final transformation which results in a non-compact representation of the transformation. We reformulate the pairwise registration problem as a recursive sequence of successive alignments. For each element in the sequence, a local deformation defined by its position, shape, and weight is computed by our recurrent registration neural network. The sum of all local deformations yield the final spatial alignment of both images. Formulating the registration problem in this way allows the network to detect non-aligned regions in the images and to learn how to locally refine the registration properly. In contrast to current non-sequence-based registration methods, our approach iteratively applies local spatial deformations to the images until the desired registration accuracy is achieved. We trained our network on 2D magnetic resonance images of the lung and compared our method to a standard parametric B-spline registration. The experiments show, that our method performs on par for the accuracy but yields a more compact representation of the transformation. Furthermore, we achieve a speedup of around 15 compared to the B-spline registration.Keywords
All Related Versions
This publication has 8 references indexed in Scilit:
- Deep learning in medical image registration: a surveyMachine Vision and Applications, 2020
- Weakly-supervised convolutional neural networks for multimodal image registrationMedical Image Analysis, 2018
- Linear and Deformable Image Registration with 3D Convolutional Neural Networks2018
- Isotropic Total Variation Regularization of Displacements in Parametric Image RegistrationIEEE Transactions on Medical Imaging, 2016
- Ultra‐fast Steady‐State Free Precession Pulse Sequence for Fourier Decomposition Pulmonary MRIMagnetic Resonance in Medicine, 2015
- Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation2014
- Deformable Medical Image Registration: A SurveyIEEE Transactions on Medical Imaging, 2013
- Nonrigid registration using free-form deformations: application to breast MR imagesIEEE Transactions on Medical Imaging, 1999