MMIS-Net for Retinal Fluid Segmentation and Detection
Authors:
Preprint
Abstract
Purpose: Deep learning methods have shown promising results in the segmentation, and detection of diseases in medical images. However, most methods are trained and tested on data from a single source, modality, organ, or disease type, overlooking the combined potential of other available annotated data. Numerous small annotated medical image datasets from various modalities, organs, and diseases are publicly available. In this work, we aim to leverage the synergistic potential of these datasets to improve performance on unseen data. Approach: To this end, we propose a novel algorithm called MMIS-Net (MultiModal Medical Image Segmentation Network), which features Similarity Fusion blocks that utilize supervision and pixel-wise similarity knowledge selection for feature map fusion. Additionally, to address inconsistent class definitions and label contradictions, we created a one-hot label space to handle classes absent in one dataset but annotated in another. MMIS-Net was trained on 10 datasets encompassing 19 organs across 2 modalities to build a single model. Results: The algorithm was evaluated on the RETOUCH grand challenge hidden test set, outperforming large foundation models for medical image segmentation and other state-of-the-art algorithms. We achieved the best mean Dice score of 0.83 and an absolute volume difference of 0.035 for the fluids segmentation task, as well as a perfect Area Under the Curve of 1 for the fluid detection task. Conclusion: The quantitative results highlight the effectiveness of our proposed model due to the incorporation of Similarity Fusion blocks into the network's backbone for supervision and similarity knowledge selection, and the use of a one-hot label space to address label class inconsistencies and contradictions.Keywords
All Related Versions
This publication has 29 references indexed in Scilit:
- SegRap2023: A benchmark of organs-at-risk and gross tumor volume Segmentation for Radiotherapy Planning of Nasopharyngeal CarcinomaMedical Image Analysis, 2025
- MA-SAM: Modality-agnostic SAM adaptation for 3D medical image segmentationMedical Image Analysis, 2024
- The applications of nature‐inspired algorithms in Internet of Things‐based healthcare service: A systematic literature reviewTransactions on Emerging Telecommunications Technologies, 2024
- The deep learning applications in IoT-based bio- and medical informatics: a systematic literature reviewNeural Computing and Applications, 2024
- Adapting Segment Anything Model (SAM) for Retinal OCT2023
- Adventures in data analysis: a systematic review of Deep Learning techniques for pattern recognition in cyber-physical-social systemsMultimedia Tools and Applications, 2023
- Medical image segmentation using deep semantic-based methods: A review of techniques, applications and emerging trendsInformation Fusion, 2022
- Resilient and dependability management in distributed environments: a systematic and comprehensive literature reviewCluster Computing, 2022
- Literature review: efficient deep neural networks techniques for medical image analysisNeural Computing and Applications, 2022
- A review of deep learning based methods for medical image multi-organ segmentationPhysica Medica, 2021