MimickNet, Mimicking Clinical Image Post- Processing Under Black-Box Constraints
- 31 January 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 39 (6) , 2277-2286
Abstract
Image post-processing is used in clinical-grade ultrasound scanners to improve image quality (e.g., reduce speckle noise and enhance contrast). These post-processing techniques vary across manufacturers and are generally kept proprietary, which presents a challenge for researchers looking to match current clinical-grade workflows. We introduce a deep learning framework, MimickNet, that transforms conventional delay-and-summed (DAS) beams into the approximate Dynamic Tissue Contrast Enhanced (DTCE™) post-processed images found on Siemens clinical-grade scanners. Training MimickNet only requires post-processed image samples from a scanner of interest without the need for explicit pairing to DAS data. This flexibility allows MimickNet to hypothetically approximate any manufacturer's post-processing without access to the pre-processed data. MimickNet post-processing achieves a 0.940 ± 0.018 structural similarity index measurement (SSIM) compared to clinical-grade post-processing on a 400 cine-loop test set, 0.937 ± 0.025 SSIM on a prospectively acquired dataset, and 0.928 ± 0.003 SSIM on an out-of-distribution cardiac cine-loop after gain adjustment. To our knowledge, this is the first work to establish deep learning models that closely approximate ultrasound post-processing found in current medical practice. MimickNet serves as a clinical post-processing baseline for future works in ultrasound image formation to compare against. Additionally, it can be used as a pretrained model for fine-tuning towards different post-processing techniques. To this end, we have made the MimickNet software, phantom data, and permitted in vivo data open-source at https://github.com/ouwen/MimickNet.Keywords
Funding Information
- National Institute of Biomedical Imaging and Bioengineering (R01-EB026574)
- National Institute of Health (5T32GM007171-44)
This publication has 40 references indexed in Scilit:
- A Primer on the Physical Principles of Tissue Harmonic ImagingRadioGraphics, 2015
- Mobile ultrafast ultrasound imaging system based on smartphone and tablet devices2015
- The Delay Multiply and Sum Beamforming Algorithm in Ultrasound B-Mode Medical ImagingIEEE Transactions on Medical Imaging, 2014
- In Vivo Application of Short-Lag Spatial Coherence and Harmonic Spatial Coherence Imaging in Fetal UltrasoundUltrasonic Imaging, 2014
- Short-lag spatial coherence of backscattered echoes: imaging characteristicsIEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2011
- Understanding the Advanced Signal Processing Technique of Real-Time Adaptive FiltersJournal of Diagnostic Medical Sonography, 2009
- Image quality assessment: from error visibility to structural similarityIEEE Transactions on Image Processing, 2004
- Evolution of ultrasound beamformers2002
- Bilateral filtering for gray and color images2002
- Tissue harmonic imaging: Why does it work?Journal of the American Society of Echocardiography, 1998