Bayesian CNN for Segmentation Uncertainty Inference on 4D Ultrasound Images of the Femoral Cartilage for Guidance in Robotic Knee Arthroscopy
Open Access
- 14 December 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 8, 223961-223975
Abstract
Ultrasound (US) imaging is a complex imaging modality, where the tissues are typically characterised by an inhomogeneous image intensity and by a variable image definition at the boundaries that depends on the direction of the incident sound wave. For this reason, conventional image segmentation approaches where the regions of interest are represented by exact masks are inherently inefficient for US images. To solve this issue, we present the first application of a Bayesian convolutional neural network (CNN) based on Monte Carlo dropout on US imaging. This approach is particularly relevant for quantitative applications since differently from traditional CNNs, it enables to infer for each image pixel not only the probability of being part of the target but also the algorithm confidence (i.e. uncertainty) in assigning that probability. In this work, this technique has been applied on US images of the femoral cartilage in the framework of a new application, where high-refresh-rate volumetric US is used for guidance in minimally invasive robotic surgery for the knee. Two options were explored, where the Bayesian CNN was trained with the femoral cartilage contoured either on US, or on magnetic resonance imaging (MRI) and then projected onto the corresponding US volume. To evaluate the segmentation performance, we propose a novel approach where a probabilistic ground-truth annotation was generated combining the femoral cartilage contours from registered US and MRI volumes. Both cases produced a significantly better segmentation performance when compared against traditional CNNs, achieving a dice score coefficient increase of about 6% and 8%, respectively.Keywords
Funding Information
- Australia-India Strategic Research Fund (AISRF53820)
This publication has 20 references indexed in Scilit:
- Leveraging uncertainty information from deep neural networks for disease detectionScientific Reports, 2017
- Bayesian Image Quality Transfer with CNNs: Exploring Uncertainty in dMRI Super-Resolution2017
- Orthopaedic surgeon attitudes towards current limitations and the potential for robotic and technological innovation in arthroscopic surgeryJournal of Orthopaedic Surgery, 2017
- Vessel Detection in Ultrasound Images Using Deep Convolutional Neural Networks2016
- Hybrid approach for automatic segmentation of fetal abdomen from ultrasound images using deep learning2016
- MRI of Articular Cartilage: Revisiting Current Status and Future DirectionsAmerican Journal of Roentgenology, 2005
- Reproducibility of interactive registration of 3D CT and MR pediatric treatment planning head imagesJournal of Applied Clinical Medical Physics, 2001
- Cartilage injuries: A review of 31,516 knee arthroscopiesArthroscopy, 1997
- Signal Detectability and Medical Decision-MakingScience, 1971
- Measures of the Amount of Ecologic Association Between SpeciesEcology, 1945