Prostate Segmentation in MRI Using Transformer Encoder and Decoder Framework
Authors:
Open Access
- 8 September 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 11, 101630-101643
Abstract
To develop an accurate segmentation model for the prostate and lesion area to help clinicians diagnose diseases, we propose a multi-encoder and decoder segmentation network, denoted Muled-Net, which can concurrently segment the prostate and lesion regions in an image. The model performs parallel calculations for dual input. In two encoder branches of the model, a new transformer encoder is used to overcome the fact that only information from the neighborhood pixels can be captured, increasing the ability to capture global dependencies. Furthermore, given the usually small size of the lesion, ASPP and feature fusion are merged to expand the perceptual field and retain more contextual information of the shallow layer in decoder. To the best of our limited knowledge, there is no public dataset for the segmentation of the prostate and its lesion regions. So we made a publicly usable dataset. Muled-Net is compared with other deep learning methods, FCN, U-Net, U-Net++, and ResU-Net with four-fold cross-validation. Of all 218 subjects, 140 healthy individuals and 78 patients with prostate cancer were included in this work. Average Dice of 95%, Iou of 89%, sensitivity of 94%, 95HD of 9.56, and MSD of 0.66 are achieved for the prostate segmentation and average Dice of 89%, Iou of 82%, sensitivity of 92%, 95HD of 11.16, and MSD of 1.09 for the segmentation of the prostate lesion regions. The performance of the proposed model has made significant improvements to the segmentation of the lesion regions in particular, suggesting that the model could be considered as an auxiliary tool to ease the workload of physicians and help them in making treatment decisions.Keywords
Funding Information
- Science and Technology Research Project of Chongqing Municipal Education Commission in 2023 (KJQN202300901)
This publication has 24 references indexed in Scilit:
- Fully automatic segmentation on prostate MR images based on cascaded fully convolution networkJournal of Magnetic Resonance Imaging, 2018
- Co-trained convolutional neural networks for automated detection of prostate cancer in multi-parametric MRIMedical Image Analysis, 2017
- PI-RADS Prostate Imaging – Reporting and Data System: 2015, Version 2European Urology, 2016
- Automatic classification of prostate cancer Gleason scores from multiparametric magnetic resonance imagesProceedings of the National Academy of Sciences, 2015
- Updated prostate imaging reporting and data system (PIRADS v2) recommendations for the detection of clinically significant prostate cancer using multiparametric MRI: critical evaluation using whole-mount pathology as standard of referenceEuropean Radiology, 2015
- Quantitative Analysis of Multiparametric Prostate MR Images: Differentiation between Prostate Cancer and Normal Tissue and Correlation with Gleason Score—A Computer-aided Diagnosis Development StudyRadiology, 2013
- Influence of imaging and histological factors on prostate cancer detection and localisation on multiparametric MRI: a prospective studyEuropean Radiology, 2013
- Computed Diffusion-weighted MR Imaging May Improve Tumor DetectionRadiology, 2011
- elastix: A Toolbox for Intensity-Based Medical Image RegistrationIEEE Transactions on Medical Imaging, 2009
- ASPP: a new family of oncogenes and tumour suppressor genesBritish Journal of Cancer, 2007