Screening for Diabetic Retinopathy Using an Automated Diagnostic System Based on Deep Learning: Diagnostic Accuracy Assessment
Authors:
- Sílvia RêgoSRSílvia Rêgo
- Marco Dutra-MedeirosMDMarco Dutra-Medeiros
- Filipe SoaresFSFilipe Soares
- Matilde Monteiro-SoaresMMMatilde Monteiro-Soares
- 29 October 2020
- journal article
- research article
- Published by S. Karger AG in Ophthalmologica
- Vol. 244 (3) , 250-257
Abstract
Purpose: To evaluate the diagnostic accuracy of a diagnostic system software for the automated screening of diabetic retinopathy (DR) on digital colour fundus photographs, the 2019 Convolutional Neural Network (CNN) model with Inception-V3. Methods: In this cross-sectional study, 295 fundus images were analysed by the CNN model and compared to a panel of ophthalmologists. Images were obtained from a dataset acquired within a screening programme. Diagnostic accuracy measures and respective 95% CI were calculated. Results: The sensitivity and specificity of the CNN model in diagnosing referable DR was 81% (95% CI 66–90%) and 97% (95% CI 95–99%), respectively. Positive predictive value was 86% (95% CI 72–94%) and negative predictive value 96% (95% CI 93–98%). The positive likelihood ratio was 33 (95% CI 15–75) and the negative was 0.20 (95% CI 0.11–0.35). Its clinical impact is demonstrated by the change observed in the pre-test probability of referable DR (assuming a prevalence of 16%) to a post-test probability for a positive test result of 86% and for a negative test result of 4%. Conclusion: A CNN model negative test result safely excludes DR, and its use may significantly reduce the burden of ophthalmologists at reading centres.Keywords
This publication has 21 references indexed in Scilit:
- The English National Screening Programme for diabetic retinopathy 2003–2016Acta Diabetologica, 2017
- Inter-observer Reliability and Agreement Study on Early Diagnosis of Diabetic Retinopathy and Diabetic Macular Edema Risk2016
- Requirements for Minimum Sample Size for Sensitivity and Specificity AnalysisJournal of Clinical and Diagnostic Research, 2016
- Telemedicine-based diabetic retinopathy screening programs: an evaluation of utility and cost-effectivenessSmart Homecare Technology and TeleHealth, 2015
- Telemedicine in diabetic retinopathy: Current status and future directionsMiddle East African Journal of Ophthalmology, 2015
- Global estimates of diabetes prevalence for 2013 and projections for 2035Diabetes Research and Clinical Practice, 2014
- Classification of diabetic retinopathy and diabetic macular edemaWorld Journal of Diabetes, 2013
- Global Prevalence and Major Risk Factors of Diabetic RetinopathyDiabetes Care, 2012
- Likelihood ratios: Clinical application in day-to-day practiceIndian Journal Of Ophthalmology, 2009
- Interobserver Agreement in the Interpretation of Single-Field Digital Fundus Images for Diabetic Retinopathy ScreeningOphthalmology, 2006