On diagnostic accuracy measure with cut-points criterion for ordinal disease classification based on concordance and discordance
Open Access
- 21 February 2022
- journal article
- research article
- Published by Taylor & Francis in Journal of Applied Statistics
- Vol. 50 (8) , 1772-1789
Abstract
The accuracy of a diagnostic test has always been essential in detecting disease staging. Many diagnostic tests of accuracy measures are used in binary diagnosis tests. Some measures apply to multi-stage diagnosis. Yet, there are limitations to the implementation, and the performance highly depends on the distribution of diagnostic outcomes. Another essential aspect of medical diagnostic testing using biomarkers is to find an optimal cut-point that categorizes a patient as diseased or healthy. This aspect was extended to the diseases with more than two stages. We propose a diagnostic accuracy measure and optimal cut-points selection (CD), using concordance and discordance for k-stages diseases. The CD measure uses the classification agreement and disagreement between tests outcomes and diseases stages. Simulations for power studies suggest that CD can detect the differences between the null and alternative hypotheses that other methods cannot for some scenarios. Simulation results indicate that using CD measures to select optimal cut-points can provide relatively high correct classification rates than the existing measures and more balanced accurate classification rates than the generalized Youden Index (GYI). An illustration is provided using the ANDI data to choose biomarkers for diagnosing Alzheimer's Disease (AD) and select optimal cut-points for the chosen biomarkers.Keywords
This publication has 21 references indexed in Scilit:
- Accuracy and cut‐off point selection in three‐class classification problems using a generalization of the Youden indexStatistics in Medicine, 2010
- Measuring and estimating diagnostic accuracy when there are three ordinal diagnostic groupsStatistics in Medicine, 2005
- Ordered multiple‐class ROC analysis with continuous measurementsStatistics in Medicine, 2004
- Ideal Observers and Optimal ROC Hypersurfaces in$N$-Class ClassificationIEEE Transactions on Medical Imaging, 2004
- ROC Curves in Clinical Chemistry: Uses, Misuses, and Possible SolutionsClinical Chemistry, 2004
- Comparing Three-class Diagnostic Tests by Three-way ROC AnalysisMedical Decision Making, 2000
- Three-way ROCsMedical Decision Making, 1999
- Generalization of the Theory of Signal Detectability ton-Eventm-Dimensional Forced-Choice TasksJournal of Mathematical Psychology, 1998
- Analysis of rating data from multiple-alternative tasksJournal of Mathematical Psychology, 1989
- Basic principles of ROC analysisSeminars in Nuclear Medicine, 1978