Evaluation of statistical methods for safety signal detection: a simulation study
Authors:
- 20 October 2014
- journal article
- research article
- Published by Wiley in Pharmaceutical Statistics
- Vol. 14 (1) , 11-19
Abstract
Proactive evaluation of drug safety with systematic screening and detection is critical to protect patients' safety and important in regulatory approval of new drug indications and postmarketing communications and label renewals. In recent years, quite a few statistical methodologies have been developed to better evaluate drug safety through the life cycle of the product development. The statistical methods for flagging safety signals have been developed in two major areas – one for data collected from spontaneous reporting system, mostly in the postmarketing area, and the other for data from clinical trials. To our knowledge, the methods developed for one area have not been applied to the other one so far. In this article, we propose to utilize all such methods for flagging safety signals in both areas regardless of which specific area they were originally developed for. Therefore, we selected eight typical methods, that is, proportional reporting ratios, reporting odds ratios, the maximum likelihood ratio test, Bayesian confidence propagation neural network method, chi‐square test for rates comparison, Benjamini and Hochberg procedure, new double false discovery rate control procedure, and Bayesian hierarchical mixture model for systematic comparison through simulations. The Benjamini and Hochberg procedure and new double false discovery rate control procedure perform best overall in terms of sensitivity and false discovery rate. The likelihood ratio test also performs well when the sample sizes are large. Copyright © 2014 John Wiley & Sons, Ltd.Keywords
This publication has 18 references indexed in Scilit:
- Flagging clinical adverse experiences: reducing false discoveries without materially compromising power for detecting true signalsStatistics in Medicine, 2012
- A Likelihood Ratio Test Based Method for Signal Detection With Application to FDA’s Drug Safety DataJournal of the American Statistical Association, 2011
- Bayesian Hierarchical Modeling for Detecting Safety Signals in Clinical TrialsJournal of Biopharmaceutical Statistics, 2011
- False Discovery Rate Control With GroupsJournal of the American Statistical Association, 2010
- Detection of Adverse Drug Reaction Signals in the Thai FDA Database: Comparison between Reporting Odds Ratio and Bayesian Confidence Propagation Neural Network MethodsDrug Information Journal, 2010
- The reporting odds ratio and its advantages over the proportional reporting ratioPharmacoepidemiology and Drug Safety, 2004
- Accounting for Multiplicities in Assessing Drug Safety: A Three‐Level Hierarchical Mixture ModelBiometrics, 2004
- The positive false discovery rate: a Bayesian interpretation and the q-valueThe Annals of Statistics, 2003
- Use of proportional reporting ratios (PRRs) for signal generation from spontaneous adverse drug reaction reportsPharmacoepidemiology and Drug Safety, 2001
- Miscellanea. A note on generating correlated binary variablesBiometrika, 1998