Deep learning-based liver segmentation for fusion-guided intervention
- 21 April 2020
- journal article
- research article
- Published by Springer Nature in International Journal of Computer Assisted Radiology and Surgery
- Vol. 15 (6) , 963-972
Abstract
Purpose Tumors often have different imaging properties, and there is no single imaging modality that can visualize all tumors. In CT-guided needle placement procedures, image fusion (e.g. with MRI, PET, or contrast CT) is often used as image guidance when the tumor is not directly visible in CT. In order to achieve image fusion, interventional CT image needs to be registered to an imaging modality, in which the tumor is visible. However, multi-modality image registration is a very challenging problem. In this work, we develop a deep learning-based liver segmentation algorithm and use the segmented surfaces to assist image fusion with the applications in guided needle placement procedures for diagnosing and treating liver tumors. Methods The developed segmentation method integrates multi-scale input and multi-scale output features in one single network for context information abstraction. The automatic segmentation results are used to register an interventional CT with a diagnostic image. The registration helps visualize the target and guide the interventional operation. Results The segmentation results demonstrated that the developed segmentation method is highly accurate with Dice of 96.1% on 70 CT scans provided by LiTS challenge. The segmentation algorithm is then applied to a set of images acquired for liver tumor intervention for surface-based image fusion. The effectiveness of the proposed methods is demonstrated through a number of clinical cases. Conclusion Our study shows that deep learning-based image segmentation can obtain useful results to help image fusion for interventional guidance. Such a technique may lead to a number of other potential applications.Keywords
Funding Information
- National Institute of Biomedical Imaging and Bioengineering (R21EB028001, R01EB027898)
This publication has 16 references indexed in Scilit:
- Deep Residual Learning for Image Recognition2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Iterative Most-Likely Point Registration (IMLP): A Robust Algorithm for Computing Optimal Shape AlignmentPLOS ONE, 2015
- Spatial Pyramid Pooling in Deep Convolutional Networks for Visual RecognitionIEEE Transactions on Pattern Analysis and Machine Intelligence, 2015
- 3D Slicer: A Platform for Subject-Specific Image Analysis, Visualization, and Clinical Support2013
- Multimodality Image Fusion–Guided Procedures: Technique, Accuracy, and ApplicationsCardioVascular and Interventional Radiology, 2012
- Interventional CT: 30 years’ experienceEuropean Radiology Supplements, 2005
- A survey of medical image registrationMedical Image Analysis, 1998
- Surface-based registration of CT images to physical space for image-guided surgery of the spine: a sensitivity studyIEEE Transactions on Medical Imaging, 1998
- A method for registration of 3-D shapesIEEE Transactions on Pattern Analysis and Machine Intelligence, 1992