Estimating the decision curve and its precision from three study designs
- 8 August 2019
- journal article
- research article
- Published by Wiley in Biometrical Journal
- Vol. 62 (3) , 764-776
Abstract
The decision curve plots the net benefitof a risk model for making decisions over a range of risk thresholds, corresponding to different ratios of misclassification costs. We discuss three methods to estimate the decision curve, together with corresponding methods of inference and methods to compare two risk models at a given risk threshold. One method uses risks (R) and a binary event indicator (Y) on the entire validation cohort. This method makes no assumptions on how well‐calibrated the risk model is nor on the incidence of disease in the population and is comparatively robust to model miscalibration. If one assumes that the model is well‐calibrated, one can compute a much more precise estimate ofbased on risksRalone. However, if the risk model is miscalibrated, serious bias can result. Case–control data can also be used to estimateif the incidence (or prevalence) of the event () is known. This strategy has comparable efficiency to using the fulldata, and its efficiency is only modestly less than that for the fulldata if the incidence is estimated from the mean ofY. We estimate variances using influence functions and propose a bootstrap procedure to obtain simultaneous confidence bands around the decision curve for a range of thresholds. The influence function approach to estimate variances can also be applied to cohorts derived from complex survey samples instead of simple random samples.Keywords
This publication has 22 references indexed in Scilit:
- Risk Prediction for Breast, Endometrial, and Ovarian Cancer in White Women Aged 50 y or Older: Derivation and Validation from Population-Based Cohort StudiesPLOS Medicine, 2013
- Benefit/Risk Assessment for Breast Cancer Chemoprevention With Raloxifene or Tamoxifen for Women Age 50 Years or OlderJournal of Clinical Oncology, 2011
- Extensions to decision curve analysis, a novel method for evaluating diagnostic tests, prediction models and molecular markersBMC Medical Informatics and Decision Making, 2008
- The Performance of Risk Prediction ModelsBiometrical Journal, 2008
- Decision Curve Analysis: A Novel Method for Evaluating Prediction ModelsMedical Decision Making, 2006
- Preoperative Nomogram Predicting the 10-Year Probability of Prostate Cancer Recurrence After Radical ProstatectomyJNCI: Journal of the National Cancer Institute, 2006
- On criteria for evaluating models of absolute riskBiostatistics, 2005
- Weak approximations for empirical Lorenz curves and their Goldie inverses of stationary observationsAdvances in Applied Probability, 1999
- Projecting Individualized Probabilities of Developing Breast Cancer for White Females Who Are Being Examined AnnuallyJNCI: Journal of the National Cancer Institute, 1989
- Confidence Bands for a Distribution Function Using the BootstrapJournal of the American Statistical Association, 1989