Construction of confidence regions in the ROC space after the estimation of the optimal Youden index‐based cut‐off point
- 21 November 2013
- journal article
- Published by Oxford University Press (OUP) in Biometrics
- Vol. 70 (1) , 212-223
Abstract
Summary: After establishing the utility of a continuous diagnostic marker investigators will typically address the question of determining a cut‐off point which will be used for diagnostic purposes in clinical decision making. The most commonly used optimality criterion for cut‐off point selection in the context of ROC curve analysis is the maximum of the Youden index. The pair of sensitivity and specificity proportions that correspond to the Youden index‐based cut‐off point characterize the performance of the diagnostic marker. Confidence intervals for sensitivity and specificity are routinely estimated based on the assumption that sensitivity and specificity are independent binomial proportions as they arise from the independent populations of diseased and healthy subjects, respectively. The Youden index‐based cut‐off point is estimated from the data and as such the resulting sensitivity and specificity proportions are in fact correlated. This correlation needs to be taken into account in order to calculate confidence intervals that result in the anticipated coverage. In this article we study parametric and non‐parametric approaches for the construction of confidence intervals for the pair of sensitivity and specificity proportions that correspond to the Youden index‐based optimal cut‐off point. These approaches result in the anticipated coverage under different scenarios for the distributions of the healthy and diseased subjects. We find that a parametric approach based on a Box–Cox transformation to normality often works well. For biomarkers following more complex distributions a non‐parametric procedure using logspline density estimation can be used.Keywords
This publication has 23 references indexed in Scilit:
- Optimal Thresholds by Maximizing or Minimizing Various Metrics via ROC-Type AnalysisAcademic Radiology, 2013
- Inference of the Youden index and associated threshold using empirical likelihood for quantilesStatistics in Medicine, 2011
- Estimation of the diagnostic threshold accounting for decision costs and sampling uncertaintyBiometrical Journal, 2010
- Footprint analysis of flatfoot in preschool-aged childrenEuropean Journal of Pediatrics, 2010
- Sample size calculations for evaluating a diagnostic test when the gold standard is missing at randomStatistics in Medicine, 2010
- ROC analysis for markers with mass at zeroStatistics in Medicine, 2005
- Comparison of Parametric and Bootstrap Approaches to Obtaining Confidence Intervals for Logspline Density EstimationJournal of Computational and Graphical Statistics, 2004
- Assessment of diagnostic markers by goodness‐of‐fit testsStatistics in Medicine, 2003
- Two transformation models for estimating an ROC curve derived from continuous dataJournal of Applied Statistics, 2000
- The Large-Sample Behavior of Transformations to NormalityJournal of the American Statistical Association, 1980