Development and Spatial External Validation of a Predictive Model of Survival Based on Random Survival Forest Analysis for People Living With HIV and AIDS After Highly Active Antiretroviral Therapy in China: Retrospective Cohort Study (Preprint)
Preprint
- 14 January 2025
- preprint
- Published by JMIR Publications Inc. in JMIR Preprints
Abstract
BACKGROUND HIV infection remains a global public health challenge, with an estimated 42.3 million cumulative deaths to date. Given the heterogeneity among people living with HIV and AIDS, there is a critical need to develop robust prognostic models to predict survival and guide individualized clinical management. OBJECTIVE We aimed to develop and externally validate a predictive model for the survival of people living with HIV and AIDS following the initiation of highly active antiretroviral therapy (HAART) in China. METHODS We used data from the HIV and AIDS epidemic surveillance system of the National Center for AIDS/STD Control and Prevention, Chinese Center for Disease Control and Prevention, for this retrospective cohort study. The training set and the external validation set included people living with HIV and AIDS from the cities of Nanjing and Nantong, respectively. The prediction model was developed by using the random survival forest (RSF), and its performance was evaluated against the Cox model, integrated area under the curve (iAUC), consistency index (C index), calibration curves, integrated Brier score (iBS), and decision curve analysis. RESULTS A total of 8960 patients were eligible for this study, consisting of 5261 (58.71%) cases in the training set (mean age 32.39, SD 13.30 years; n=4891, 92.97% male patients) and 3699 (41.28%) cases in the external validation set (mean age 43.31, SD 14.18 years; n=3086, 83.42% male patients). The RSF model was developed based on the top 7 variables ranked by variable importance, including hemoglobin, age at HAART treatment, infection route, white blood cell count, education level, blood glucose, and the CD4 count before HAART. The RSF model exhibited good performance, with an iBS of 0.129 in the internal validation set and 0.113 in the external validation set, and a C index of 0.896 (95% CI 0.885-0.906) in the internal validation set and 0.756 (95% CI 0.730-0.782) in the external validation set, respectively. The iAUC was 0.917 (95% CI 0.906-0.929) for the internal validation set and 0.750 (95% CI 0.724-0.776) for the external validation set. Using the Cox model as the benchmark model, the variables included in the RSF model yielded an iBS of 0.172 and 0.115, a C index of 0.829 (95% CI 0.815-0.842) and 0.742 (95% CI 0.714-0.770), and an iAUC of 0.871 (95% CI 0.856-0.885) and 0.740 (95% CI 0.711-0.768) for the internal and external validation sets, respectively. CONCLUSIONS A machine learning–based RSF model demonstrated promising potential for providing personalized and accurate survival predictions and effective prognostic stratification for people living with HIV and AIDS following HAART in China. Compared to the Cox model, the RSF model exhibited slightly superior performance. A web-based application of the RSF model provides a practical tool for risk assessment and clinical decision-making.Keywords
All Related Versions
- Published version: Journal of Medical Internet Research, 27, e71257.
This publication has 14 references indexed in Scilit:
- Development and external validation of a prognostic model for survival of people living with HIV/AIDS initiating antiretroviral therapyThe Lancet Regional Health - Western Pacific, 2021
- Long-term protection from HIV infection with oral HIV pre-exposure prophylaxis in gay and bisexual men: findings from the expanded and extended EPIC-NSW prospective implementation studyThe Lancet HIV, 2021
- Development and validation of a prognostic nomogram for HIV/AIDS patients who underwent antiretroviral therapy: Data from a China population-based cohortEBioMedicine, 2019
- Enhancing Multimedia Imbalanced Concept Detection Using VIMP in Random Forests2016
- Outcomes and factors associated with survival of patients with HIV/AIDS initiating antiretroviral treatment in Liangshan Prefecture, southwest of ChinaMedicine, 2016
- Emerging Disparity in HIV/AIDS Disease Progression and Mortality for Men Who Have Sex with Men, Jiangsu Province, ChinaAIDS and Behavior, 2013
- Bisexual behavior among Chinese young migrant men who have sex with men: implications for HIV prevention and interventionAIDS Care, 2011
- Prognosis of patients with HIV-1 infection starting antiretroviral therapy in sub-Saharan Africa: a collaborative analysis of scale-up programmesThe Lancet, 2010
- Calculation and use of an HIV-1 disease progression scoreAIDS, 2000
- Multivariate Models for Predicting Progression to AIDS and Survival in Human Immunodeficiency Virus-Infected PersonsThe Journal of Infectious Diseases, 1995