Meta‐analysis of diagnostic accuracy studies with multiple thresholds: Comparison of different approaches
Authors:
Open Access
- 21 January 2021
- journal article
- research article
- Published by Wiley in Biometrical Journal
- Vol. 63 (4) , 699-711
Abstract
Methods for standard meta‐analysis of diagnostic test accuracy studies are well established and understood. For the more complex case in which studies report test accuracy across multiple thresholds, several approaches have recently been proposed. These are based on similar ideas, but make different assumptions. In this article, we apply four different approaches to data from a recent systematic review in the area of nephrology and compare the results. The four approaches use: a linear mixed effects model, a Bayesian multinomial random effects model, a time‐to‐event model and a nonparametric model, respectively. In the case study data, the accuracy of neutrophil gelatinase‐associated lipocalin for the diagnosis of acute kidney injury was assessed in different scenarios, with sensitivity and specificity estimates available for three thresholds in each primary study. All approaches led to plausible and mostly similar summary results. However, we found considerable differences in results for some scenarios, for example, differences in the area under the receiver operating characteristic curve (AUC) of up to 0.13. The Bayesian approach tended to lead to the highest values of the AUC, and the nonparametric approach tended to produce the lowest values across the different scenarios. Though we recommend using these approaches, our findings motivate the need for a simulation study to explore optimal choice of method in various scenarios.Keywords
This publication has 31 references indexed in Scilit:
- Chapter 8: Meta-analysis of Test Performance When There is a “Gold Standard”Journal of General Internal Medicine, 2012
- QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy StudiesAnnals of Internal Medicine, 2011
- Meta‐Analysis of Diagnostic Test Accuracy Studies with Multiple Thresholds using Survival MethodsBiometrical Journal, 2010
- Multivariate random effects meta-analysis of diagnostic tests with multiple thresholdsBMC Medical Research Methodology, 2009
- The predictive performance of plasma neutrophil gelatinase-associated lipocalin (NGAL) increases with grade of acute kidney injuryNephrology Dialysis Transplantation, 2009
- Multivariate Random-Effects Approach: For Meta-Analysis of Cancer Staging StudiesAcademic Radiology, 2007
- Confidence Intervals for the Youden Index and Corresponding Optimal Cut-PointCommunications in Statistics - Simulation and Computation, 2007
- Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approachJournal of Clinical Epidemiology, 2006
- Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviewsJournal of Clinical Epidemiology, 2005
- A latent normal distribution model for analysing ordinal responses with applications in meta‐analysisStatistics in Medicine, 2004