DoFE: Domain-Oriented Feature Embedding for Generalizable Fundus Image Segmentation on Unseen Datasets
- 10 August 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Imaging
- Vol. 39 (12) , 4237-4248
Abstract
Deep convolutional neural networks have significantly boosted the performance of fundus image segmentation when test datasets have the same distribution as the training datasets. However, in clinical practice, medical images often exhibit variations in appearance for various reasons, e.g., different scanner vendors and image quality. These distribution discrepancies could lead the deep networks to over-fit on the training datasets and lack generalization ability on the unseen test datasets. To alleviate this issue, we present a novel Domain-oriented Feature Embedding (DoFE) framework to improve the generalization ability of CNNs on unseen target domains by exploring the knowledge from multiple source domains. Our DoFE framework dynamically enriches the image features with additional domain prior knowledge learned from multi-source domains to make the semantic features more discriminative. Specifically, we introduce a Domain Knowledge Pool to learn and memorize the prior information extracted from multi-source domains. Then the original image features are augmented with domain-oriented aggregated features, which are induced from the knowledge pool based on the similarity between the input image and multi-source domain images. We further design a novel domain code prediction branch to infer this similarity and employ an attention-guided mechanism to dynamically combine the aggregated features with the semantic features. We comprehensively evaluate our DoFE framework on two fundus image segmentation tasks, including the optic cup and disc segmentation and vessel segmentation. Our DoFE framework generates satisfying segmentation results on unseen datasets and surpasses other domain generalization and network regularization methods.Keywords
All Related Versions
Funding Information
- Key-Area Research and Development Program of Guangdong Province, China (2020B010165004)
- Hong Kong Innovation and Technology Fund (ITS/426/17FP, ITS/311/18FP)
- National Natural Science Foundation of China (U1813204)
This publication has 38 references indexed in Scilit:
- Domain Generalization for Object Recognition with Multi-task Autoencoders2015
- Robust Vessel Segmentation in Fundus ImagesInternational Journal of Biomedical Imaging, 2013
- Superpixel Classification Based Optic Disc and Optic Cup Segmentation for Glaucoma ScreeningIEEE Transactions on Medical Imaging, 2013
- An Ensemble Classification-Based Approach Applied to Retinal Blood Vessel SegmentationIEEE Transactions on Biomedical Engineering, 2012
- Semi-Supervised Learning (Chapelle, O. et al., Eds.; 2006) [Book reviews]IEEE Transactions on Neural Networks, 2009
- Automated Segmentation of the Optic Disc from Stereo Color Photographs Using Physiologically Plausible FeaturesInvestigative Ophthalmology & Visual Science, 2007
- Ridge-Based Vessel Segmentation in Color Images of the RetinaIEEE Transactions on Medical Imaging, 2004
- Optic Nerve Head SegmentationIEEE Transactions on Medical Imaging, 2004
- Locating blood vessels in retinal images by piecewise threshold probing of a matched filter responseIEEE Transactions on Medical Imaging, 2000
- Vertical cup/disc ratio in relation to optic disc size: its value in the assessment of the glaucoma suspectBritish Journal of Ophthalmology, 1998