Target‐oriented deep learning‐based image registration with individualized test‐time adaptation
Authors:
- 24 May 2023
- journal article
- research article
- Published by Wiley in Medical Physics
- Vol. 50 (11) , 7016-7026
Abstract
Background: A classic approach in medical image registration is to formulate an optimization problem based on the image pair of interest, and seek a deformation vector field (DVF) to minimize the corresponding objective, often iteratively. It has a clear focus on the targeted pair, but is typically slow. In contrast, more recent deep‐learning‐based registration offers a much faster alternative and can benefit from data‐driven regularization. However, learning is a process to “fit” the training cohort, whose image or motion characteristics or both may differ from the pair of images to be tested, which is the ultimate goal of registration. Therefore, generalization gap poses a high risk with direct inference alone. Purpose: In this study, we propose an individualized adaptation to improve test sample targeting, to achieve a synergy of efficiency and performance in registration.Methods: Using a previously developed network with an integrated motion representation prior module as the implementation backbone, we propose to adapt the trained registration network further for image pairs at test time to optimize the individualized performance. The adaptation method was tested against various characteristics shifts caused by cross‐protocol, cross‐platform, and cross‐modality, with test evaluation performed on lung CBCT, cardiac MRI, and lung MRI, respectively.Results: Landmark‐based registration errors and motion‐compensated image enhancement results demonstrated significantly improved test registration performance from our method, compared to tuned classic B‐spline registration and network solutions without adaptation.Conclusions: We have developed a method to synergistically combine the effectiveness of pre‐trained deep network and the target‐centric perspective of optimization‐based registration to improve performance on individual test data.Keywords
Funding Information
- Varian Medical Systems
This publication has 34 references indexed in Scilit:
- A longitudinal four‐dimensional computed tomography and cone beam computed tomography dataset for image‐guided radiation therapy research in lung cancerMedical Physics, 2016
- Four challenges in medical image analysis from an industrial perspectiveMedical Image Analysis, 2016
- TIGRE: a MATLAB-GPU toolbox for CBCT image reconstructionBiomedical Physics & Engineering Express, 2016
- Domain Generalization for Object Recognition with Multi-task Autoencoders2015
- Benchmarking framework for myocardial tracking and deformation algorithms: An open access databaseMedical Image Analysis, 2013
- Medical image registration: a reviewComputer Methods in Biomechanics and Biomedical Engineering, 2012
- Four-dimensional deformable image registration using trajectory modelingPhysics in Medicine & Biology, 2009
- Learning from Imbalanced DataIEEE Transactions on Knowledge and Data Engineering, 2009
- A framework for evaluation of deformable image registration spatial accuracy using large landmark point setsPhysics in Medicine & Biology, 2009
- Practical cone-beam algorithmJournal of the Optical Society of America A, 1984