Rate and Predictors of Misclassification of Active Diabetic Macular Edema as Detected by an Automated Retinal Image Analysis System
Open Access
- 8 April 2024
- journal article
- research article
- Published by Springer Nature in Ophthalmology and Therapy
- Vol. 13 (6) , 1553-1567
Abstract
Introduction The aim of this work is to estimate the sensitivity, specificity, and misclassification rate of an automated retinal image analysis system (ARIAS) in diagnosing active diabetic macular edema (DME) and to identify factors associated with true and false positives. Methods We conducted a cross-sectional study of prospectively enrolled patients with diabetes mellitus (DM) referred to a tertiary medical retina center for screening or management of DME. All patients underwent two-field fundus photography (macula- and disc-centered) with a true-color confocal camera; images were processed by EyeArt V.2.1.0 (Woodland Hills, CA, USA). Active DME was defined as the presence of intraretinal or subretinal fluid on spectral-domain optical coherence tomography (SD-OCT). Sensitivity and specificity and their 95% confidence intervals (CIs) were calculated. Variables associated with true (i.e., DME labeled as present by ARIAS + fluid on SD-OCT) and false positives (i.e., DME labeled as present by ARIAS + no fluid on SD-OCT) of active DME were explored. Results A total of 298 eyes were included; 92 eyes (31%) had active DME. ARIAS sensitivity and specificity were 82.61% (95% CI 72.37–89.60) and 84.47% (95% CI 78.34–89.10). The misclassification rate was 16%. Factors associated with true positives included younger age (p = 0.01), shorter DM duration (p = 0.006), presence of hard exudates (p = 0.005), and microaneurysms (p = 0.002). Factors associated with false positives included longer DM duration (p = 0.01), worse diabetic retinopathy severity (p = 0.008), history of inactivated DME (p < 0.001), and presence of hard exudates (p < 0.001), microaneurysms (p < 0.001), or epiretinal membrane (p = 0.06). Conclusions The sensitivity of ARIAS was diminished in older patients and those without DME-related fundus lesions, while the specificity was reduced in cases with a history of inactivated DME. ARIAS performed well in screening for naïve DME but is not effective in surveillance inactivated DME.Keywords
This publication has 35 references indexed in Scilit:
- Pivotal Evaluation of an Artificial Intelligence System for Autonomous Detection of Referrable and Vision-Threatening Diabetic RetinopathyJAMA Network Open, 2021
- Diabetic macular edemaDisease-a-Month, 2021
- Persistent or Recurrent Diabetic Macular Edema After Fluocinolone Acetonide 0.19 mg Implant: Risk Factors and ManagementAmerican Journal of Ophthalmology, 2020
- Performance of a Deep-Learning Algorithm vs Manual Grading for Detecting Diabetic Retinopathy in IndiaJAMA Ophthalmology, 2019
- Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus PhotographsJAMA, 2016
- Comparison of Prevalence of Diabetic Macular Edema Based on Monocular Fundus Photography vs Optical Coherence TomographyJAMA Ophthalmology, 2016
- Effects of Intravitreal Ranibizumab on Retinal Hard Exudate in Diabetic Macular EdemaOphthalmology, 2015
- Automated Retinal Image Analysis for Diabetic Retinopathy in TelemedicineCurrent Diabetes Reports, 2015
- Sample size estimation in diagnostic test studies of biomedical informaticsJournal of Biomedical Informatics, 2014
- Automated Analysis of Retinal Images for Detection of Referable Diabetic RetinopathyJAMA Ophthalmology, 2013