Relative Performance of Model Selection Criteria for Cox Proportional Hazards Regression Based on Kullback’s Symmetric Divergence
Open Access
- 29 January 2025
- journal article
- research article
- Published by Wiley in Journal of Probability and Statistics
- Vol. 2025 (1)
Abstract
The Cox proportional hazards model is one of the most used models to analyze time‐to‐event outcomes. The decision on the most suitable model for those data is an essential analysis point. For this purpose, different model selection criteria can be used under various assumptions. This study assesses the relative performance of new model selection criteria based on Kullback’s symmetric divergence in the Cox proportional hazards model. For this purpose, we compared the Kullback information criterion (KIC) and the corrected KIC(KIC c ) with other information criteria such as the Akaike information criterion (AIC), corrected AIC( A IC c ), and Bayesian information criterion (BIC) using a Monte Carlo experiment. Simulations were run using scenarios resulting from the combination of sample size ( n = 30, 50, 100, 200, 300), censoring percentage ( C = 5%, 10%, 15%, 20%, 25%, and 30%), and censoring distribution (uniform or exponential). The results revealed that the KIC family criteria favor models with more accurate predictive power, irrespective of sample size or censoring percentage. However, they tend to select more underfitted models, which means that the KIC family favors parsimonious models, regardless of sample size or censoring percentage. A larger sample size ( n = 200, 300) improves the performance of these criteria in choosing the true model, irrespective of the censoring percentage. However, AIC and AIC c outperform the KIC family criteria for relatively small to moderate sample sizes ( n = 30, 50, 100) in true model (containing only the relevant covariates) selection. In addition, BIC tends to favor underfitted models over KIC family criteria. Variations in censoring percentage, sample size, and censoring distribution affect the performance of these criteria in identifying the true model. These findings suggest that we should prefer KIC or KIC c for larger sample sizes and when prioritizing the predictive accuracy of the model. For smaller sample sizes, we should prefer AIC or AIC c , and BIC in scenarios where model parsimony is critical. It is important to note that no model selection criterion is the best in all situations, as they performed differently under different circumstances.Keywords
Funding Information
- German Academic Exchange Service (57588035)
This publication has 23 references indexed in Scilit:
- The Akaike information criterion: Background, derivation, properties, application, interpretation, and refinementsWIREs Computational Statistics, 2019
- Survival analysis, part 2: Kaplan-Meier method and the log-rank testAmerican Journal of Orthodontics and Dentofacial Orthopedics, 2017
- An Akaike information criterion for multiple event mixture cure modelsEuropean Journal of Operational Research, 2015
- Model selection criteria for overdispersed data and their application to the characterization of a host-parasite relationshipEnvironmental and Ecological Statistics, 2013
- An evaluation of penalised survival methods for developing prognostic models with rare eventsStatistics in Medicine, 2011
- Improved AIC selection strategy for survival analysisComputational Statistics & Data Analysis, 2008
- Model selection criteria based on Kullback information measures for nonlinear regressionJournal of Statistical Planning and Inference, 2005
- Generating survival times to simulate Cox proportional hazards modelsStatistics in Medicine, 2005
- A large-sample model selection criterion based on Kullback's symmetric divergenceStatistics & Probability Letters, 1999
- Regression and time series model selection in small samplesBiometrika, 1989