Tubular shape aware data generation for segmentation in medical imaging
- 17 April 2022
- journal article
- research article
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 17 (6) , 1091-1099
Abstract
Purpose Chest X-ray is one of the most widespread examinations of the human body. In interventional radiology, its use is frequently associated with the need to visualize various tube-like objects, such as puncture needles, guiding sheaths, wires, and catheters. Detection and precise localization of these tube-like objects in the X-ray images are, therefore, of utmost value, catalyzing the development of accurate target-specific segmentation algorithms. Similar to the other medical imaging tasks, the manual pixel-wise annotation of the tubes is a resource-consuming process. Methods In this work, we aim to alleviate the lack of annotated images by using artificial data. Specifically, we present an approach for synthetic generation of the tube-shaped objects, with a generative adversarial network being regularized with a prior-shape constraint. Namely, our model uses Frangi-based regularization to draw synthetic tubes in the predefined fake mask regions and, then, uses the adversarial component to preserve the global realistic appearance of the synthesized image. Results Our method eliminates the need for the paired image–mask data and requires only a weakly labeled dataset, with fine-tuning on a small paired sample (10–20 images) proving sufficient to reach the accuracy of the fully supervised models. Conclusion We report the applicability of the approach for the task of segmenting tubes and catheters in the X-ray images, whereas the results should also hold for the other acquisition modalities and image computing applications that contain tubular objects.Keywords
All Related Versions
This publication has 23 references indexed in Scilit:
- Synthesizing retinal and neuronal images with generative adversarial netsMedical Image Analysis, 2018
- A Deep-Learning System for Fully-Automated Peripherally Inserted Central Catheter (PICC) Tip DetectionJournal of Digital Imaging, 2017
- End-to-End Adversarial Retinal Image SynthesisIEEE Transactions on Medical Imaging, 2017
- Least Squares Generative Adversarial Networks2017
- Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks2017
- ChestX-Ray8: Hospital-Scale Chest X-Ray Database and Benchmarks on Weakly-Supervised Classification and Localization of Common Thorax Diseases2017
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Statistical shape models for 3D medical image segmentation: A reviewMedical Image Analysis, 2009
- Multiscale vessel enhancement filtering1998
- 3D multi-scale line filter for segmentation and visualization of curvilinear structures in medical images1997