Using population-wide electronic health records for timely contemporary assessment of cardiovascular disease risk prediction model performance: COVID-19 impact on the SCORE2 models

Authors:

Abstract
Aims: Risk estimation is key for the primary prevention of cardiovascular diseases (CVD). The European Society of Cardiology recommends SCORE2, SCORE2-OP (Older Persons), and SCORE2-Diabetes [collectively, the SCORE2 family-of-models (FOMs)] for 10-year CVD risk estimation. As the COVID-19 pandemic was associated with higher CVD incidences, we externally validated the SCORE2-FOMs using contemporary nationwide data and assessed the need for adaptation. Methods: Using population-wide electronic health records (EHRs) for England, we defined a cohort of 26.5 million individuals aged 40–89 years without prior CVD on 1 January 2022 followed up until 31 December 2023. We calculated annual incidence rates of CVD events and non-CVD mortality by sex and 1-year age groups to estimate expected 10-year, competing risk adjusted, CVD risk using a life table approach. We assessed SCORE2-FOM calibration and discrimination, overall and by subgroups. Results: Within 2 years of follow-up, 239 815 incident CVD events occurred. For SCORE2, SCORE2-Diabetes, and SCORE2-OP, the C-index values were 0.75 (95% CI: 0.75–0.76), 0.71 (0.71–0.71), and 0.65 (0.65–0.65), respectively. SCORE2-FOMs overpredicted CVD risks by 3%–4% in males and by 8%–14% in females, with calibration variations by English region and ethnic group. Elevated CVD risk associated with a recent COVID-19 hospitalization led SCORE2 to underestimate risks by 2% in affected males aged 40–69 years. Conclusion: The SCORE2-FOMs demonstrated good calibration and discrimination, suggesting that no adaptation is needed in response to the COVID-19 pandemic. Short-term EHRs provide a valuable resource for timely contemporary risk model validation and, if necessary, for adaptation according to shifts in CVD trends.
Funding Information
  • Medical Research Council Canada (MR/N013433/1)
  • British Heart Foundation (RG/18/13/33946)
  • British Heart Foundation (RG/F/23/110103)
  • British Heart Foundation Chair (CH/12/2/29428)
  • Medical Research Council
  • Engineering and Physical Sciences Research Council
  • Economic and Social Research Council
  • Department of Health and Social Care
  • Chief Scientist Office
  • Scottish Government Health and Social Care Directorates
  • Health and Social Care Research and Development Division
  • Llywodraeth Cymru
  • Public Health Agency
  • Wellcome Trust
  • National Institute for Health and Care Research
  • NIHR Cambridge Biomedical Research Centre
  • BHF Centre for Research Excellence (RE/18/1/34212)
  • BHF Centre for Research Excellence (RE/24/130011)
  • BHF Centre for Research Excellence (SP/19/3/34678)
  • Cancer Research UK
  • NIHR Barts Biomedical Research Centre, Queen Mary University of London (NIHR203312)
  • Health Data Research UK (HDR-23012)
  • Applied Research Collaboration East Midlands
  • NIHR Leicester Biomedical Research Centre
  • Barwon Health Foundation
  • Centre of Excellence
  • Blood and Transplant Research Unit
  • BTRU
  • Donor Health and Behaviour (NIHR203337)
  • BHF Cambridge Centre for Research Excellence (RE/24/130011)
  • BHF Data Science Centre (HDRUK2023.0239)
  • National Institute for Health and Care Research (NIHR303137)

This publication has 31 references indexed in Scilit: