Generative Adversarial Registration Network for Multi-Contrast Liver MRI Registration and Added Value to Hepatocellular Carcinoma Segmentation: A Multicentre Study
- 1 February 2024
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Emerging Topics in Computational Intelligence
- Vol. 8 (2) , 1714-1727
Abstract
Diffusion-weighted imaging (DWI) and dynamic contrast-enhanced (DCE) imaging are essential for the diagnosis of hepatocellular carcinoma (HCC) but suffer from severe displacement due to respiratory and cardiac motions. The currently available registration algorithms do not align the multi-contrast liver images satisfactorily, which hinders the efficacy of automatic lesion segmentation and radiomics analysis. We proposed a deep learning-based generative adversarial registration network (GARNET) for multi-contrast liver image registration and explored the added value on HCC lesion segmentation in patients with cirrhosis. The proposed model applied a pre-trained generative adversarial network to synthesize DCE images from DWI and then used diffeomorphic based symmetric image normalization (SyN) algorithm for registration. Furthermore, an attention-based U-net (AU-NET) was used to segment the HCC lesion from registered DWI and DCE images. GARNET was developed and validated on 901 patients collected between January 2013 and February 2021 across five medical centers, including 517 HCC patients, total of 597 HCCs, and every case was interpolated to 32 slices. GARNET achieved the highest liver registration Dice (0.812 ± 0.045) among all comparative methods, and the lowest tumor target registration error (3.470 ± 1.652 mm) for DWI/DCE registrations. In addition, the performance of HCC segmentation was significantly improved when using registered images from GARNET, with Dice improvements from 0.36 ± 0.22 to 0.45 ± 0.22; 0.53 ± 0.25 to 0.58 ± 0.21; and 0.44 ± 0.26 to 0.56 ± 0.19 in three validation centers. Experimental results showed that GARNET significantly improved the liver registration performances among multi-contrast images, thereby improving the further identification and segmentation of HCCs.Keywords
Funding Information
- National Natural Science Foundation of China (82271956, 81971583)
- National Key R&D Program of China (2018YFC1312900)
- Shanghai Sailing Program (20YF1402400)
- Natural Science Foundation of Shanghai Municipality (20ZR1406400)
- Shanghai Municipal Science and Technology Major Project (2017SHZDZX01, 2018SHZDZX01)
- ZJLab
This publication has 45 references indexed in Scilit:
- MDReg‐Net: Multi‐resolution diffeomorphic image registration using fully convolutional networks with deep self‐supervisionHuman Brain Mapping, 2022
- Synth-by-Reg (SbR): Contrastive Learning for Synthesis-Based Registration of Paired Images2021
- mlVIRNET: Multilevel Variational Image Registration Network2019
- Synthesis and Inpainting-Based MR-CT Registration for Image-Guided Thermal Ablation of Liver Tumors2019
- Image synthesis-based multi-modal image registration framework by using deep fully convolutional networksMedical & Biological Engineering & Computing, 2018
- Role of Diffusion Weighted Imaging (DWI) for Hepatocellular Carcinoma (HCC) Detection and its Grading on 3T MRI: A Prospective StudyJournal of Clinical and Experimental Hepatology, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Mesh deformation-based multi-tissue mesh generation for brain imagesEngineering with Computers, 2012
- Entropy and Laplacian images: Structural representations for multi-modal registrationMedical Image Analysis, 2012
- Symmetric diffeomorphic image registration with cross-correlation: Evaluating automated labeling of elderly and neurodegenerative brainMedical Image Analysis, 2008