Development and validation of a prediction tool to support engagement in HIV care among young people ages 10–24 years in Kenya
Open Access
- 30 June 2023
- journal article
- research article
- Published by Public Library of Science (PLoS) in PLOS ONE
- Vol. 18 (6) , e0286240
Abstract
Introduction: Loss to follow-up (LTFU) among adolescents and young adults living with HIV (AYALWH) is a barrier to optimal health and HIV services. We developed and validated a clinical prediction tool to identify AYALWH at risk of LTFU. Methods: We used electronic medical records (EMR) of AYALWH ages 10 to 24 in HIV care at 6 facilities in Kenya and surveys from a subset of participants. Early LTFU was defined as >30 days late for a scheduled visit in the last 6 months, which accounts for clients with multi-month refills. We developed a tool combining surveys with EMR (‘survey-plus-EMR tool’), and an ‘EMR-alone’ tool to predict high, medium, and low risk of LTFU. The survey-plus-EMR tool included candidate sociodemographics, partnership status, mental health, peer support, any unmet clinic needs, WHO stage, and time in care variables for tool development, while the EMR-alone included clinical and time in care variables only. Tools were developed in a 50% random sample of the data and internally validated using 10-fold cross-validation of the full sample. Tool performance was evaluated using Hazard Ratios (HR), 95% Confidence Intervals (CI), and area under the curve (AUC) ≥ 0.7 for good performance and ≥0.60 for modest performance. Results: Data from 865 AYALWH were included in the survey-plus-EMR tool and early LTFU was (19.2%, 166/865). The survey-plus-EMR tool ranged from 0 to 4, including PHQ-9 ≥5, lack of peer support group attendance, and any unmet clinical need. High (3 or 4) and medium (2) prediction scores were associated with greater risk of LTFU (high, 29.0%, HR 2.16, 95%CI: 1.25–3.73; medium, 21.4%, HR 1.52, 95%CI: 0.93–2.49, global p-value = 0.02) in the validation dataset. The 10-fold cross validation AUC was 0.66 (95%CI: 0.63–0.72). Data from 2,696 AYALWH were included in the EMR-alone tool and early LTFU was 28.6% (770/2,696). In the validation dataset, high (score = 2, LTFU = 38.5%, HR 2.40, 95%CI: 1.17–4.96) and medium scores (1, 29.6%, HR 1.65, 95%CI: 1.00–2.72) predicted significantly higher LTFU than low-risk scores (0, 22.0%, global p-value = 0.03). Ten-fold cross-validation AUC was 0.61 (95%CI: 0.59–0.64). Conclusions: Clinical prediction of LTFU was modest using the surveys-plus-EMR tool and the EMR-alone tool, suggesting limited use in routine care. However, findings may inform future prediction tools and intervention targets to reduce LTFU among AYALWH.Keywords
Funding Information
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (UG3 HD096906)
- Center for AIDS Research, University of Washington (P30 AI027757)
This publication has 56 references indexed in Scilit:
- Towards better clinical prediction models: seven steps for development and an ABCD for validationEuropean Heart Journal, 2014
- Determinants of Mortality and Loss to Follow-Up among Adults Enrolled in HIV Care Services in RwandaPLOS ONE, 2014
- Risk prediction models: II. External validation, model updating, and impact assessmentHeart, 2012
- Risk prediction models: I. Development, internal validation, and assessing the incremental value of a new (bio)markerHeart, 2012
- Developing and validating a risk scoring tool for chlamydia infection among sexual health clinic attendees in Australia: a simple algorithm to identify those at high risk of chlamydia infectionBMJ Open, 2011
- Assessing the Performance of Prediction ModelsEpidemiology, 2010
- An abbreviated version of the Connor-Davidson Resilience Scale (CD-RISC), the CD-RISC2: Psychometric properties and applications in psychopharmacological trialsPsychiatry Research, 2007
- Users' Guides to the Medical LiteratureJAMA, 2000
- The AUDIT Alcohol Consumption Questions (AUDIT-C)An Effective Brief Screening Test for Problem DrinkingArchives of internal medicine (1960), 1998
- An Ecological Perspective on Health Promotion ProgramsHealth Education Quarterly, 1988