Learning disentangled representations for unpaired synthesis of high-resolution dynamic MRI
Open Access
- 1 February 2025
- journal article
- Published by Machine Learning for Biomedical Imaging in Machine Learning for Biomedical Imaging
- Vol. 3 (February 2) , 16-37
Abstract
Image-to-image (I2I) synthesis aims at learning the mapping between two visual domains. Due to the scarcity of paired datasets, learning such transformation may be challenging. With a growing number of publications each year, unpaired I2I synthesis has drawn attention from the research community and has found a great application field in medical imaging. Disentangled representation learning constitutes a significant portion of these methods. By relying on the factorization of an image into independent variation latent codes, this approach offers greater control over the result of the synthesis than GAN-based ones. However, disentangling latent representations is not a trivial task and may be influenced by particular inductive bias. In this work, we propose to apply disentangled representation learning to the unpaired synthesis of high-resolution dynamic MRI. We study the impact of both the entanglement module and the addition of a segmentation auxiliary task on the result of the synthesis and the disentanglement of the representations. Our results demonstrate that the choice of the entanglement module greatly influences the learning of a good representation, and that the addition of a segmentation auxiliary task leads to better synthesis performances. Our code is available at https://github.com/cScavinner/Unpaired_image_synthesisKeywords
This publication has 14 references indexed in Scilit:
- A survey of emerging applications of diffusion probabilistic models in MRIMeta-Radiology, 2024
- Target-Guided Diffusion Models for Unpaired Cross-Modality Medical Image TranslationIEEE Journal of Biomedical and Health Informatics, 2024
- Deep learning based unpaired image-to-image translation applications for medical physics: a systematic reviewPhysics in Medicine & Biology, 2023
- Improving reproducibility and performance of radiomics in low‐dose CT using cycle GANsJournal of Applied Clinical Medical Physics, 2022
- Learning disentangled representations in the imaging domainMedical Image Analysis, 2022
- MouseGAN: GAN-Based Multiple MRI Modalities Synthesis and Segmentation for Mouse Brain Structures2021
- TorchIO: A Python library for efficient loading, preprocessing, augmentation and patch-based sampling of medical images in deep learningComputer Methods and Programs in Biomedicine, 2021
- DRIT++: Diverse Image-to-Image Translation via Disentangled RepresentationsInternational Journal of Computer Vision, 2020
- Disentangled representation learning in cardiac image analysisMedical Image Analysis, 2019
- Dynamic Cardiac MR Imaging Techniques and ApplicationsRadiologic Clinics of North America, 1989