Simplifying a prognostic model: a simulation study based on clinical data
Authors:
- 2 December 2002
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 21 (24) , 3803-3822
Abstract
Prognostic models are designed to predict a clinical outcome in individuals or groups of individuals with a particular disease or condition. To avoid bias many researchers advocate the use of full models developed by prespecifying predictors. Variable selection is not employed and the resulting models may be large and complicated. In practice more parsimonious models that retain most of the prognostic information may be preferred. We investigate the effect on various performance measures, including mean square error and prognostic classification, of three methods for estimating full models (including penalized estimation and Tibshirani's lasso) and consider two methods (backwards elimination and a new proposal called stepdown) for simplifying full models. Simulation studies based on two medical data sets suggest that simplified models can be found that perform nearly as well as, or sometimes even better than, full models. Optimizing the Akaike information criterion appears to be appropriate for choosing the degree of simplification. Copyright © 2002 John Wiley & Sons, Ltd.Keywords
This publication has 24 references indexed in Scilit:
- Regression Modeling Strategies2001
- What do we mean by validating a prognostic model?Statistics in Medicine, 2000
- Stepwise Selection in Small Data Sets A Simulation Study of Bias in Logistic Regression AnalysisJournal of Clinical Epidemiology, 1999
- The Use of Resampling Methods to Simplify Regression Models in Medical StatisticsJournal of the Royal Statistical Society Series C: Applied Statistics, 1999
- Building Multivariable Prognostic and Diagnostic Models: Transformation of the Predictors by Using Fractional PolynomialsJournal of the Royal Statistical Society Series A: Statistics in Society, 1999
- RANDOMIZED AND NON-RANDOMIZED PATIENTS IN CLINICAL TRIALS: EXPERIENCES WITH COMPREHENSIVE COHORT STUDIESStatistics in Medicine, 1996
- Commentary: Prognostic models: clinically useful or quickly forgotten?BMJ, 1995
- Regression Using Fractional Polynomials of Continuous Covariates: Parsimonious Parametric ModellingJournal of the Royal Statistical Society Series C: Applied Statistics, 1994
- Ridge Estimators in Logistic RegressionJournal of the Royal Statistical Society Series C: Applied Statistics, 1992
- The meaning and use of the area under a receiver operating characteristic (ROC) curve.Radiology, 1982