Guidance for deriving and presenting percentage study weights in meta‐analysis of test accuracy studies
- 8 January 2018
- journal article
- research article
- Published by Wiley in Research Synthesis Methods
- Vol. 9 (2) , 163-178
Abstract
Percentage study weights in meta‐analysis reveal the contribution of each study toward the overall summary results and are especially important when some studies are considered outliers or at high risk of bias. In meta‐analyses of test accuracy reviews, such as a bivariate meta‐analysis of sensitivity and specificity, the percentage study weights are not currently derived. Rather, the focus is on representing the precision of study estimates on receiver operating characteristic plots by scaling the points relative to the study sample size or to their standard error. In this article, we recommend that researchers should also provide the percentage study weights directly, and we propose a method to derive them based on a decomposition of Fisher information matrix. This method also generalises to a bivariate meta‐regression so that percentage study weights can also be derived for estimates of study‐level modifiers of test accuracy. Application is made to two meta‐analyses examining test accuracy: one of ear temperature for diagnosis of fever in children and the other of positron emission tomography for diagnosis of Alzheimer's disease. These highlight that the percentage study weights provide important information that is otherwise hidden if the presentation only focuses on precision based on sample size or standard errors. Software code is provided for Stata, and we suggest that our proposed percentage weights should be routinely added on forest and receiver operating characteristic plots for sensitivity and specificity, to provide transparency of the contribution of each study toward the results. This has implications for the PRISMA–diagnostic test accuracy guidelines that are currently being produced.Keywords
This publication has 22 references indexed in Scilit:
- Individual Participant Data Meta-Analysis for a Binary Outcome: One-Stage or Two-Stage?PLOS ONE, 2013
- QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy StudiesAnnals of Internal Medicine, 2011
- ‘Cross hairs’ plots for diagnostic meta‐analysisResearch Synthesis Methods, 2010
- Meta‐analysis of diagnostic test studies using individual patient data and aggregate dataStatistics in Medicine, 2008
- Bivariate meta-analysis of sensitivity and specificity with sparse data: a generalized linear mixed model approachJournal of Clinical Epidemiology, 2006
- In a systematic review, infrared ear thermometry for fever diagnosis in children finds poor sensitivityJournal of Clinical Epidemiology, 2006
- Bivariate analysis of sensitivity and specificity produces informative summary measures in diagnostic reviewsJournal of Clinical Epidemiology, 2005
- What to add to nothing? Use and avoidance of continuity corrections in meta‐analysis of sparse dataStatistics in Medicine, 2004
- Meta-analytic methods for diagnostic test accuracyJournal of Clinical Epidemiology, 1995
- A bivariate approach to meta‐analysisStatistics in Medicine, 1993