Evaluation of diagnostic accuracy in detecting ordered symptom statuses without a gold standard
Open Access
- 5 January 2011
- journal article
- research article
- Published by Oxford University Press (OUP) in Biostatistics
- Vol. 12 (3) , 567-581
Abstract
Our research is motivated by 2 methodological problems in assessing diagnostic accuracy of traditional Chinese medicine (TCM) doctors in detecting a particular symptom whose true status has an ordinal scale and is unknown—imperfect gold standard bias and ordinal scale symptom status. In this paper, we proposed a nonparametric maximum likelihood method for estimating and comparing the accuracy of different doctors in detecting a particular symptom without a gold standard when the true symptom status had an ordered multiple class. In addition, we extended the concept of the area under the receiver operating characteristic curve to a hyper-dimensional overall accuracy for diagnostic accuracy and alternative graphs for displaying a visual result. The simulation studies showed that the proposed method had good performance in terms of bias and mean squared error. Finally, we applied our method to our motivating example on assessing the diagnostic abilities of 5 TCM doctors in detecting symptoms related to Chills disease.Keywords
This publication has 15 references indexed in Scilit:
- ROC Graphs for Assessing the Ability of a Diagnostic Marker to Detect Three Disease Classes with an Umbrella OrderingBiometrics, 2007
- Knowledge discovery in traditional Chinese medicine: State of the art and perspectivesArtificial Intelligence in Medicine, 2006
- Ordered multiple‐class ROC analysis with continuous measurementsStatistics in Medicine, 2004
- Assessing the diagnostic accuracy of a sequence of testsBiostatistics, 2003
- Nonparametric estimation of component distributions in a multivariate mixtureThe Annals of Statistics, 2003
- A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification ProblemsMachine Learning, 2001
- Three-way ROCsMedical Decision Making, 1999
- A Biomedical Application of Latent Class Models with Random EffectsJournal of the Royal Statistical Society Series C: Applied Statistics, 1998
- Evaluation of diagnostic tests without gold standardsStatistical Methods in Medical Research, 1998
- Receiver Operator characteristic (ROC) Analysis without TruthMedical Decision Making, 1990