Multi-scale U-net with Edge Guidance for Multimodal Retinal Image Deformable Registration
Authors:
- 1 July 2020
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2020, 1360-1363
Abstract
Registration of multimodal retinal images is of great importance in facilitating the diagnosis and treatment of many eye diseases, such as the registration between color fundus images and optical coherence tomography (OCT) images. However, it is difficult to obtain ground truth, and most existing algorithms are for rigid registration without considering the optical distortion. In this paper, we present an unsupervised learning method for deformable registration between the two images. To solve the registration problem, the structure achieves a multi-level receptive field and takes contour and local detail into account. To measure the edge difference caused by different distortions in the optics center and edge, an edge similarity (ES) loss term is proposed, so loss function is composed by local cross-correlation, edge similarity and diffusion regularizer on the spatial gradients of the deformation matrix. Thus, we propose a multi-scale input layer, U-net with dilated convolution structure, squeeze excitation (SE) block and spatial transformer layers. Quantitative experiments prove the proposed framework is best compared with several conventional and deep learningbased methods, and our ES loss and structure combined with Unet and multi-scale layers achieve competitive results for normal and abnormal images.Keywords
This publication has 10 references indexed in Scilit:
- Multi-scale dilated convolution of convolutional neural network for image denoisingMultimedia Tools and Applications, 2019
- Squeeze-and-Excitation Networks2018
- An Unsupervised Learning Model for Deformable Medical Image Registration2018
- Automatic 2-D/3-D Vessel Enhancement in Multiple Modality Images Using a Weighted Symmetry FilterIEEE Transactions on Medical Imaging, 2017
- A CNN Regression Approach for Real-Time 2D/3D RegistrationIEEE Transactions on Medical Imaging, 2016
- Deformable Medical Image Registration: A SurveyIEEE Transactions on Medical Imaging, 2013
- A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image RegistrationIEEE Transactions on Biomedical Engineering, 2010
- Registration of Challenging Image Pairs: Initialization, Estimation, and DecisionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2007
- Distinctive Image Features from Scale-Invariant KeypointsInternational Journal of Computer Vision, 2004
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004