Clip-Driven Universal Model for Multi-Material Decomposition in Dual-Energy CT
- 20 January 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Imaging
- Vol. 11 (25730436) , 349-361
Abstract
Dual-energy computed tomography (DECT) offers quantitative insights and facilitates material decomposition, aiding in precise diagnosis and treatment planning. However, existing methods for material decomposition, often tailored to specific material types, need more generalizability and increase computational load with each additional material. We propose a CLIP-Driven Universal Model for adaptive Multi-Material Decomposition (MMD) to tackle this challenge. This model utilizes the semantic capabilities of text embeddings from Contrastive Language-Image Pre-training (CLIP), allowing a single network to manage structured feature embedding for multiple materials. A novel Siamese encoder and differential map fusion technique have also been integrated to enhance the decomposition accuracy while maintaining robustness across various conditions. Experiments on the simulated and physical patient studies have evidenced our model's superiority over traditional methods. Notably, it has significantly improved the Dice Similarity Coefficient—4.1%. These results underscore the potential of our network in clinical MMD applications, suggesting a promising avenue for enhancing DECT imaging analysis.Keywords
Funding Information
- Beijing Natural Science Foundation (Z210008, L222049)
- Basic and Applied Basic Research Foundation of Guangdong Province (2024A0505040005, 2024A1515011897)
- National Natural Science Foundation of China (82372041)
This publication has 34 references indexed in Scilit:
- Report on the AAPM deep‐learning spectral CT Grand ChallengeMedical Physics, 2023
- Simple Baselines for Image Restoration2022
- Improved GAN: Using a transformer module generator approach for material decompositionComputers in Biology and Medicine, 2022
- A material decomposition method for dual‐energy CT via dual interactive Wasserstein generative adversarial networksMedical Physics, 2021
- Image synthesis with deep convolutional generative adversarial networks for material decomposition in dual-energy CT from a kilovoltage CTComputers in Biology and Medicine, 2021
- Protocol analysis of dual-energy CT for optimization of kidney stone detection in virtual non-contrast reconstructionsEuropean Radiology, 2020
- Image domain dual material decomposition for dual‐energy CT using butterfly networkMedical Physics, 2019
- A learning‐based material decomposition pipeline for multi‐energy x‐ray imagingMedical Physics, 2018
- Material density iodine images in dual-energy CT: Detection and characterization of hypervascular liver lesions compared to magnetic resonance imagingEuropean Journal of Radiology, 2017
- The assessment of intracranial bleeding with virtual unenhanced imaging by means of dual-energy CT angiographyEuropean Radiology, 2009