Two-way partial AUC and its properties
Authors:
- 14 July 2017
- journal article
- research article
- Published by SAGE Publications in Statistical Methods in Medical Research
- Vol. 28 (1) , 184-195
Abstract
Simultaneous control on true positive rate and false positive rate is of significant importance in the performance evaluation of diagnostic tests. Most of the established literature utilizes partial area under receiver operating characteristic (ROC) curve with restrictions only on false positive rate (FPR), called FPR pAUC, as a performance measure. However, its indirect control on true positive rate (TPR) is conceptually and practically misleading. In this paper, a novel and intuitive performance measure, named as two-way pAUC, is proposed, which directly quantifies partial area under ROC curve with explicit restrictions on both TPR and FPR. To estimate two-way pAUC, we devise a nonparametric estimator. Based on the estimator, a bootstrap-assisted testing method for two-way pAUC comparison is established. Moreover, to evaluate possible covariate effects on two-way pAUC, a regression analysis framework is constructed. Asymptotic normalities of the methods are provided. Advantages of the proposed methods are illustrated by simulation and Wisconsin Breast Cancer Data. We encode the methods as a publicly available R package tpAUC.Keywords
All Related Versions
This publication has 14 references indexed in Scilit:
- Jackknife variance of the partial area under the empirical receiver operating characteristic curveStatistical Methods in Medical Research, 2014
- On use of partial area under the ROC curve for evaluation of diagnostic performanceStatistics in Medicine, 2013
- Estimation of AUC or Partial AUC Under Test-Result-Dependent SamplingStatistics in Biopharmaceutical Research, 2012
- Partial AUC Estimation and RegressionBiometrics, 2003
- Semiparametric Regression for the Area Under the Receiver Operating Characteristic CurveJournal of the American Statistical Association, 2003
- A non‐parametric method for the comparison of partial areas under ROC curves and its application to large health care data setsStatistics in Medicine, 2002
- A receiver operating characteristic partial area index for highly sensitive diagnostic tests.Radiology, 1996
- Analyzing a Portion of the ROC CurveMedical Decision Making, 1989
- Measuring the Accuracy of Diagnostic SystemsScience, 1988
- On the Unique Consistent Solution to the Likelihood EquationsJournal of the American Statistical Association, 1977