High-fidelity medical image generation: controllable synthesis of high-resolution medical images via hierarchical fusion in vector-quantized generative networks
Open Access
- 11 November 2025
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Physics
- Vol. 13, 1661146
Abstract
Objective: High-resolution medical images are scarce, and existing image generation methods perform poorly at high resolutions, struggling with the representation of small lesions, loss of detailed information, distortion of anatomical structure, high computational cost, and mode collapse. This study aims to develop a novel generative framework to address the challenges of high-resolution medical image generation. Methods: Clinical X-ray data from 255 patients and a public dataset containing 1,657 lung CT images with lung nodules were collected. We propose a pioneering medical image generation method that employs a two-route synthesis strategy: a foreground generation route that utilizes a generative model from a single lesion image (SinGAN) to create new lesion configurations and structures while preserving the original patch distribution and a background generation route that utilizes a high-fidelity medical image generation model, high-resolution medical image (HiResMed) Vector-Quantized Generative Adversarial Network (VQGAN), which incorporates a hierarchical dual-path fusion block (HDFB) and integrates it into a VQGAN, trained on the collected data. The HDFB module combines a dual-path learning strategy: a residual path with skip connections to capture hierarchical dependencies and multi-scale textures and a multi-scale convolutional feedforward feature extraction module (MSConvFE) that preserves low-level anatomical features through localized detail enhancement. Finally, based on the location of lesions in historical data as prior knowledge to guide the fusion position of the synthesized lesions in the background image, a high-resolution synthetic medical image with small lesions is obtained. We compared our method with denoising diffusion model (DDM), StyleSwin, VQGAN, and SinGAN using Frechet Inception Distance (FID), learned perceptual image patch similarity (LPIPS), peak signal-to-noise ratio (PSNR), and structural similarity (SSIM). Two urologists participated in a visual Turing test to assess perceptual fidelity. Results: The experimental results demonstrate that the proposed method achieves state-of-the-art performance, reducing FID by 43.3% (145.64 vs. 256.11) and LPIPS by 5% (0.48 vs. 0.51), enhancing the PSNR by 4% (59.03 vs. 56.54) and SSIM by 6% (0.67 vs. 0.63), and accelerating training convergence by 83% compared to baseline VQGAN. Clinicians misclassified 55% of synthetic images as real, validating their anatomical fidelity. Conclusion: This study proposes a method for generating high-resolution medical images of small lesions. It not only ensures high-quality lesion generation but also allows controls over the number and location of lesions. Moreover, the innovative architecture enhances the detailed quality of anatomical structures and improves computational efficiency during training.Keywords
Funding Information
- Basic and Applied Basic Research Foundation of Guangdong Province (2021B1515140038)
- National Natural Science Foundation of China (82274413)
- Natural Science Foundation of Guangdong Province (2025A1515010184)
- Shenzhen Science and Technology Innovation Program (JCYJ20240813141424032)
- Guangdong Province for Science and Technology Innovative Young Talents (2024KQNCX042 2023KQNCX123)
This publication has 43 references indexed in Scilit:
- Quantum generative learning for high-resolution medical image generationMachine Learning: Science and Technology, 2025
- HiFi-Syn: Hierarchical granularity discrimination for high-fidelity synthesis of MR images with structure preservationMedical Image Analysis, 2024
- Generative Artificial Intelligence Biases, Limitations and Risks in Nuclear Medicine: An Argument for Appropriate Use Framework and RecommendationsSeminars in Nuclear Medicine, 2024
- Structure-preserving image translation for multi-source medical image domain adaptationPattern Recognition, 2023
- GAN review: Models and medical image fusion applicationsInformation Fusion, 2022
- Generative Adversarial Networks in the built environment: A comprehensive review of the application of GANs across data types and scalesBuilding and Environment, 2022
- Indocyanine Green Fluorescence Navigation in Liver SurgeryAnnals of Surgery, 2022
- High resolution histopathology image generation and segmentation through adversarial trainingMedical Image Analysis, 2022
- Multi-scale GANs for Memory-efficient Generation of High Resolution Medical Images2019
- Note on the Sampling Error of the Difference Between Correlated Proportions or PercentagesPsychometrika, 1947