Multi‐eXpert fusion: An ensemble learning framework to segment 3D TRUS prostate images
Authors:
- 29 April 2022
- journal article
- research article
- Published by Wiley in Medical Physics
- Vol. 49 (8) , 5138-5148
Abstract
Purpose: Prostate segmentation of 3D TRUS images is a prerequisite for several diagnostic and therapeutic applications. Unfortunately, this difficult task suffers from high intra and interobserver variability, even for experienced urologists/radiologists. This is why automatic segmentation algorithms could have a significant clinical added‐value.Methods: This paper introduces a new deep segmentation architecture consisting of two main phases: view‐specific segmentations of 2D slices and their fusion. The segmentation phase is based on three segmentation networks trained in parallel on specific slice viewing directions: axial, coronal, and sagittal. The proposed fusion network is then fed with the output of the segmentation networks and trained to produce three confidence maps. These maps correspond to the local trust granted by the fusion network to each view‐specific segmentation network. Finally, for a given slice, the segmentation is computed by combining these confidence maps with their corresponding segmentations. The 3D segmentation of the prostate is obtained by restacking all the segmented slices to form a volume.Results: This approach was evaluated on a database of 100 patients with several combinations of network architectures (for both the segmentation phase and the fusion phase) to show the flexibility and reliability of the framework. The proposed approach was also compared to STAPLE, to the majority voting strategy, and to a direct 3D approach tested on the same database. The new method outperforms these three approaches on all evaluation criteria. Finally, the results of the multi‐eXpert fusion (MXF) framework compare favorably with other state‐of‐the‐art methods, while these methods typically work on smaller databases.Conclusions: We proposed a novel MXF framework to segment 3D TRUS images of the prostate. The main feature of this approach is the fusion of expert network results at the pixel level using computed confidence maps. Experiments conducted on a clinical database have shown the robustness and flexibility of this approach and its superiority over state‐of‐the‐art approaches. Finally, the MXF framework demonstrated its ability to capture and preserve the underlying gland structures, particularly in the base and apex regions.Keywords
Funding Information
- Région Auvergne-Rhône-Alpes (ProNavIA)
- Agence Nationale de la Recherche (ANR‐19‐P3IA‐0003, ANR‐11‐LABX‐0004)
This publication has 18 references indexed in Scilit:
- Deep Attentive Features for Prostate Segmentation in 3D Transrectal UltrasoundIEEE Transactions on Medical Imaging, 2019
- Deep Q Learning Driven CT Pancreas Segmentation With Geometry-Aware U-NetIEEE Transactions on Medical Imaging, 2019
- Accurate and Robust Segmentation of the Clinical Target Volume for Prostate Brachytherapy2018
- V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation2016
- 3D transrectal ultrasound (TRUS) prostate segmentation based on optimal feature learning frameworkProceedings of SPIE, 2016
- Rotationally resliced 3D prostate TRUS segmentation using convex optimization with shape priorsMedical Physics, 2015
- 3D prostate segmentation of ultrasound images combining longitudinal image registration and machine learningProceedings of SPIE, 2012
- Automated segmentation of the prostate in 3D MR images using a probabilistic atlas and a spatially constrained deformable modelMedical Physics, 2010
- Simultaneous Truth and Performance Level Estimation (STAPLE): An Algorithm for the Validation of Image SegmentationIEEE Transactions on Medical Imaging, 2004
- Intra- and inter-observer variability and reliability of prostate volume measurement via two-dimensional and three-dimensional ultrasound imagingUltrasound in Medicine & Biology, 1998