Real-world feasibility, accuracy and acceptability of automated retinal photography and AI-based cardiovascular disease risk assessment in Australian primary care settings: a pragmatic trial
Top Cited Papers
Open Access
- 24 February 2025
- journal article
- research article
- Published by Springer Nature in npj Digital Medicine
- Vol. 8 (1) , 1-9
Abstract
We aim to assess the real-world accuracy (primary outcome), feasibility and acceptability (secondary outcomes) of an automated retinal photography and artificial intelligence (AI)-based cardiovascular disease (CVD) risk assessment system (rpCVD) in Australian primary care settings. Participants aged 45–70 years who had recently undergone all or part of a CVD risk assessment were recruited from two general practice clinics in Victoria, Australia. After consenting, participants underwent retinal imaging using an automated fundus camera, and an rpCVD risk score was generated by a deep learning algorithm. This score was compared against the World Health Organisation (WHO) CVD risk score, which incorporates age, sex, and other clinical risk factors. The predictive accuracy of the rpCVD and WHO CVD risk scores for 10-year incident CVD events was evaluated using data from the UK Biobank, with the accuracy of each system assessed through the area under the receiver operating characteristic curve (AUC). Participant satisfaction was assessed through a survey, and the imaging success rate was determined by the percentage of individuals with images of sufficient quality to produce an rpCVD risk score. Of the 361 participants, 339 received an rpCVD risk score, resulting in a 93.9% imaging success rate. The rpCVD risk scores showed a moderate correlation with the WHO CVD risk scores (Pearson correlation coefficient [PCC] = 0.526, 95% CI: 0.444–0.599). Despite this, the rpCVD system, which relies solely on retinal images, demonstrated a similar level of accuracy in predicting 10-year incident CVD (AUC = 0.672, 95% CI: 0.658-0.686) compared to the WHO CVD risk score (AUC = 0.693, 95% CI: 0.680-0.707). High satisfaction rates were reported, with 92.5% of participants and 87.5% of general practitioners (GPs) expressing satisfaction with the system. The automated rpCVD system, using only retinal photographs, demonstrated predictive accuracy comparable to the WHO CVD risk score, which incorporates multiple clinical factors including age, the most heavily weighted factor for CVD prediction. This underscores the potential of the rpCVD approach as a faster, easier, and non-invasive alternative for CVD risk assessment in primary care settings, avoiding the need for more complex clinical procedures.Keywords
Funding Information
- University of Melbourne
- The NHMRC Investigator Grant (APP1175405, APP1175405)
- Medical Research Future Fund (MRFAI00035)
- Global STEM Professorship Scheme (P0046113)
- the Fundamental Research Funds of the State Key Laboratory of Ophthalmology
- Project of Investigation on Health Status of Employees in Financial Industry in Guangzhou, China (Z012014075)
This publication has 35 references indexed in Scilit:
- Absolute risk of cardiovascular disease events, and blood pressure‐ and lipid‐lowering therapy in AustraliaMedical Journal of Australia, 2016
- UK Biobank: An Open Access Resource for Identifying the Causes of a Wide Range of Complex Diseases of Middle and Old AgePLOS Medicine, 2015
- The eye and the heartEuropean Heart Journal, 2013
- Multi-disease Health Screening in an Urban Low-income Setting: A Community-based StudyAnnals of the Academy of Medicine, Singapore, 2010
- Meta-analysis: Retinal Vessel Caliber and Risk for Coronary Heart DiseaseAnnals of Internal Medicine, 2009
- Age as a modifiable risk factor for cardiovascular diseaseThe Lancet, 2008
- The Bold Promise Project: a system change in primary care to support cardiovascular risk screening.2006
- Measuring agreement in method comparison studiesStatistical Methods in Medical Research, 1999
- Sex, Age, Cardiovascular Risk Factors, and Coronary Heart DiseaseCirculation, 1999
- Prediction of Coronary Heart Disease Using Risk Factor CategoriesCirculation, 1998