Improved nonparametric survival prediction using CoxPH, Random Survival Forest & DeepHit Neural Network
Authors:
Open Access
- 7 May 2024
- journal article
- research article
- Published by Springer Nature in BMC Medical Informatics and Decision Making
- Vol. 24 (1) , 1-17
Abstract
In recent times, time-to-event data such as time to failure or death is routinely collected alongside high-throughput covariates. These high-dimensional bioinformatics data often challenge classical survival models, which are either infeasible to fit or produce low prediction accuracy due to overfitting. To address this issue, the focus has shifted towards introducing a novel approaches for feature selection and survival prediction. In this article, we propose a new hybrid feature selection approach that handles high-dimensional bioinformatics datasets for improved survival prediction. This study explores the efficacy of four distinct variable selection techniques: LASSO, RSF-vs, SCAD, and CoxBoost, in the context of non-parametric biomedical survival prediction. Leveraging these methods, we conducted comprehensive variable selection processes. Subsequently, survival analysis models—specifically CoxPH, RSF, and DeepHit NN—were employed to construct predictive models based on the selected variables. Furthermore, we introduce a novel approach wherein only variables consistently selected by a majority of the aforementioned feature selection techniques are considered. This innovative strategy, referred to as the proposed method, aims to enhance the reliability and robustness of variable selection, subsequently improving the predictive performance of the survival analysis models. To evaluate the effectiveness of the proposed method, we compare the performance of the proposed approach with the existing LASSO, RSF-vs, SCAD, and CoxBoost techniques using various performance metrics including integrated brier score (IBS), concordance index (C-Index) and integrated absolute error (IAE) for numerous high-dimensional survival datasets. The real data applications reveal that the proposed method outperforms the competing methods in terms of survival prediction accuracy.Keywords
This publication has 42 references indexed in Scilit:
- Continuous and discrete-time survival prediction with neural networksLifetime Data Analysis, 2021
- Integrated Square Error of Hazard Rate Estimation for Survival Data with Missing Censoring IndicatorsJournal of Systems Science and Complexity, 2021
- On the choice and influence of the number of boosting steps for high-dimensional linear Cox-modelsComputational Statistics, 2017
- Group descent algorithms for nonconvex penalized linear and logistic regression models with grouped predictorsStatistics and Computing, 2013
- On the C‐statistics for evaluating overall adequacy of risk prediction procedures with censored survival dataStatistics in Medicine, 2011
- Higher CD34+ and CD3+ Cell Doses in the Graft Promote Long-Term Survival, and Have No Impact on the Incidence of Severe Acute or Chronic Graft-versus-Host Disease after In Vivo T Cell-Depleted Unrelated Donor Hematopoietic Stem Cell Transplantation in ChildrenTransplantation and Cellular Therapy, 2010
- Assessment and comparison of prognostic classification schemes for survival dataStatistics in Medicine, 1999
- Boosting a Weak Learning Algorithm by MajorityInformation and Computation, 1995
- The strength of weak learnabilityMachine Learning, 1990
- Regression modelling strategies for improved prognostic predictionStatistics in Medicine, 1984