Uncertainty-inspired open set learning for retinal anomaly identification
Top Cited Papers
Open Access
- 24 October 2023
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 14 (1) , 1-11
Abstract
Failure to recognize samples from the classes unseen during training is a major limitation of artificial intelligence in the real-world implementation for recognition and classification of retinal anomalies. We establish an uncertainty-inspired open set (UIOS) model, which is trained with fundus images of 9 retinal conditions. Besides assessing the probability of each category, UIOS also calculates an uncertainty score to express its confidence. Our UIOS model with thresholding strategy achieves an F1 score of 99.55%, 97.01% and 91.91% for the internal testing set, external target categories (TC)-JSIEC dataset and TC-unseen testing set, respectively, compared to the F1 score of 92.20%, 80.69% and 64.74% by the standard AI model. Furthermore, UIOS correctly predicts high uncertainty scores, which would prompt the need for a manual check in the datasets of non-target categories retinal diseases, low-quality fundus images, and non-fundus images. UIOS provides a robust method for real-world screening of retinal anomalies.Keywords
Funding Information
- Agency for Science, Technology and Research (C222812010)
This publication has 42 references indexed in Scilit:
- Aleatoric uncertainty estimation with test-time augmentation for medical image segmentation with convolutional neural networksNeurocomputing, 2019
- RETOUCH: The Retinal OCT Fluid Detection and Segmentation Benchmark and ChallengeIEEE Transactions on Medical Imaging, 2019
- Development and Validation of a Deep Learning System for Diabetic Retinopathy and Related Eye Diseases Using Retinal Images From Multiethnic Populations With DiabetesJAMA, 2017
- A survey on deep learning in medical image analysisMedical Image Analysis, 2017
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Deep Residual Learning for Image Recognition2016
- The Pascal Visual Object Classes Challenge: A RetrospectiveInternational Journal of Computer Vision, 2014
- Dirichlet and Related Distributions2011
- The Youden Index and the Optimal Cut‐Point Corrected for Measurement ErrorBiometrical Journal, 2005
- A Practical Bayesian Framework for Backpropagation NetworksNeural Computation, 1992