Evaluation of the degree of agreement in the diagnosis of diabetic retinopathy between ophthalmologists and EyeArt®
Open Access
- 19 November 2025
- journal article
- research article
- Published by Springer Nature in International Journal of Retina and Vitreous
- Vol. 11 (1) , 125
Abstract
Objective or purpose: To evaluate the diagnostic performance and agreement of the EyeArt ® Artificial Intelligence (AI) system for detecting Diabetic Retinopathy (DR), comparing its results with ophthalmologists’ assessments in a regional screening program. Design: Cross-sectional observational study. Subjects, participants, and/or controls: A total of 498 diabetic patients aged 18 years or older were enrolled between June and September 2023 through the Retisalud DR screening program in the Canary Islands. No separate control group was included. Methods: All participants underwent non-mydriatic fundus photography using the TRC-NW400 camera. Retinal images were analyzed by the EyeArt ® AI system (version 2.1.0), and results were compared with assessments by ophthalmologists based on the International Clinical Diabetic Retinopathy scale (ICDR). Agreement was quantified using Cohen’s kappa coefficient. Additionally, mixed-effects logistic regression was used to explore associations between DR and clinical risk factors. Main outcome measures: Sensitivity, specificity, and agreement (Cohen’s kappa) of the AI system compared to clinical diagnosis; predictors of DR such as age, diabetes duration, presence of Diabetic Macular Edema (DME), and central retinal thickness (CRT-OCT). Results: The EyeArt® system achieved a binocular sensitivity of 100% (95% CI: 98.1–100) and a specificity of 93.5% (95% CI: 90.2–96.0). Agreement with ophthalmologist grading was excellent, with kappa values of 0.966 (right eye) and 0.978 (left eye). Younger age, longer diabetes duration, DME presence, and higher CRT were significantly associated with DR diagnosis. Conclusions: The EyeArt ® AI system showed excellent diagnostic accuracy and strong agreement with clinical evaluations in DR screening. Nonetheless, its tendency to overestimate DR severity indicates the need for further refinement of its grading algorithm. These findings support the potential integration of AI systems into large-scale DR screening programs, pending further validation.Keywords
All Related Versions
This publication has 59 references indexed in Scilit:
- The relationship of diabetic retinopathy severity scales with frequency and surface area of diabetic retinopathy lesionsGraefe's Archive for Clinical and Experimental Ophthalmology, 2023
- Artificial intelligence in diabetic retinopathy: Bibliometric analysisComputer Methods and Programs in Biomedicine, 2023
- Emerging Insights and Interventions for Diabetic RetinopathyCurrent Diabetes Reports, 2019
- Artificial Intelligence Screening for Diabetic Retinopathy: the Real-World Emerging ApplicationCurrent Diabetes Reports, 2019
- Telemedicine for Diabetic Retinopathy ScreeningJAMA Ophthalmology, 2017
- Binocular sensitivity and specificity of screening tests in cross‐sectional diagnostic studies of paired organsStatistics in Medicine, 2017
- Artificial Intelligence With Deep Learning Technology Looks Into Diabetic Retinopathy ScreeningJAMA, 2016
- Evaluation of Automated Teleretinal Screening Program for Diabetic RetinopathyJAMA Ophthalmology, 2016
- Long-term Comparative Effectiveness of Telemedicine in Providing Diabetic Retinopathy Screening ExaminationsJAMA Ophthalmology, 2015
- Socioeconomic Disparity in Use of Eye Care Services Among US Adults With Age-Related Eye DiseasesJAMA Ophthalmology, 2013