Joint modeling of sensitivity and specificity
Authors:
- 2 January 2008
- journal article
- research article
- Published by Wiley in Statistics in Medicine
- Vol. 27 (10) , 1745-1761
Abstract
Sensitivity and specificity are two customary performance measures associated with medical diagnostic tests. Typically, they are modeled independently as a function of risk factors using logistic regression, which provides estimated functions for these probabilities. Change in these probabilities across levels of risk factors is of primary interest and the indirect relationship is often displayed using a receiver operating characteristic curve. We refer to this as analysis of ‘first‐order’ behavior. Here, we consider what we refer to as ‘second‐order’ behavior where we examine the stochastic dependence between the (random) estimates of sensitivity and specificity. To do so, we argue that a model for the four cell probabilities that determine the joint distribution of screening test result and outcome result is needed. Such a modeling induces sensitivity and specificity as functions of these cell probabilities. In turn, this raises the issue of a coherent specification for these cell probabilities, given risk factors, i.e. a specification that ensures that all probabilities calculated under it fall between 0 and 1. This leads to the question of how to provide models that are coherent and mechanistically appropriate as well as computationally feasible to fit, particularly with large data sets. The goal of this article is to illuminate these issues both algebraically and through analysis of a real data set. Copyright © 2008 John Wiley & Sons, Ltd.Keywords
This publication has 20 references indexed in Scilit:
- Performance assessment for radiologists interpreting screening mammographyStatistics in Medicine, 2006
- Examining accuracy of screening mammography using an event order modelStatistics in Medicine, 2005
- Accuracy of Screening Mammography Interpretation by Characteristics of RadiologistsJNCI: Journal of the National Cancer Institute, 2004
- Comparison of Screening Mammography in the United States and the United KingdomJAMA, 2003
- Identifiability, Improper Priors, and Gibbs Sampling for Generalized Linear ModelsJournal of the American Statistical Association, 1999
- Breast Cancer Surveillance Consortium: a national mammography screening and outcomes database.American Journal of Roentgenology, 1997
- Variability in Radiologists' Interpretations of MammogramsNew England Journal of Medicine, 1994
- Discussion: Markov Chains for Exploring Posterior DistributionsThe Annals of Statistics, 1994
- The Case for Case-Mix Adjustment in Practice ProfilingJAMA, 1994
- Adaptive Rejection Sampling for Gibbs SamplingJournal of the Royal Statistical Society Series C: Applied Statistics, 1992