Appearance Learning for Image-Based Motion Estimation in Tomography
- 15 June 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 39 (11) , 3667-3678
Abstract
In tomographic imaging, anatomical structures are reconstructed by applying a pseudo-inverse forward model to acquired signals. Geometric information within this process is usually depending on the system setting only, i. e., the scanner position or readout direction. Patient motion therefore corrupts the geometry alignment in the reconstruction process resulting in motion artifacts. We propose an appearance learning approach recognizing the structures of rigid motion independently from the scanned object. To this end, we train a siamese triplet network to predict the reprojection error (RPE) for the complete acquisition as well as an approximate distribution of the RPE along the single views from the reconstructed volume in a multi-task learning approach. The RPE measures the motioninduced geometric deviations independent of the object based on virtual marker positions, which are available during training. We train our network using 27 patients and deploy a 21- 4-2 split for training, validation and testing. In average, we achieve a residual mean RPE of 0.013mm with an inter-patient standard deviation of 0.022 mm. This is twice the accuracy compared to previously published results. In a motion estimation benchmark the proposed approach achieves superior results in comparison with two state-of-the-art measures in nine out of twelve experiments. The clinical applicability of the proposed method is demonstrated on a motion-affected clinical dataset.Keywords
All Related Versions
This publication has 47 references indexed in Scilit:
- Image features for misalignment correction in medical flat‐detector CTMedical Physics, 2012
- Prospective real‐time correction for arbitrary head motion using active markersMagnetic Resonance in Medicine, 2009
- On NUFFT-based gridding for non-Cartesian MRIJournal of Magnetic Resonance, 2007
- Self‐gated cardiac cine MRIMagnetic Resonance in Medicine, 2003
- Kernel-based object trackingIEEE Transactions on Pattern Analysis and Machine Intelligence, 2003
- Active appearance models1998
- A cone-beam reconstruction algorithm using shift-variant filtering and cone-beam backprojectionIEEE Transactions on Medical Imaging, 1994
- Practical cone-beam algorithmJournal of the Optical Society of America A, 1984
- Optimal short scan convolution reconstruction for fan beam CTMedical Physics, 1982
- The Nelder-Mead Simplex Procedure for Function MinimizationTechnometrics, 1975