Validation of New Signal Detection Methods for Web Query Log Data Compared to Signal Detection Algorithms Used With FAERS
- 2 February 2017
- journal article
- research article
- Published by Springer Nature in Drug Safety
- Vol. 40 (5) , 399-408
Abstract
Introduction Post-marketing drug surveillance is largely based on signals found in spontaneous reports from patients and healthcare providers. Rare adverse drug reactions and adverse events (AEs) that may develop after long-term exposure to a drug or from drug interactions may be missed. The US FDA and others have proposed that web-based data could be mined as a resource to detect latent signals associated with adverse drug reactions. Methods Recently, a web-based search query method called a query log reaction score (QLRS) was developed to detect whether AEs associated with certain drugs could be found from search engine query data. In this study, we compare the performance of two other algorithms, the proportional query ratio (PQR) and the proportional query rate ratio (Q-PRR) against that of two reference signal-detection algorithms (SDAs) commonly used with the FDA AE Reporting System (FAERS) database. Results In summary, the web query methods have moderate sensitivity (80%) in detecting signals in web query data compared with reference SDAs in FAERS when the web query data are filtered, but the query metrics generate many false-positives and have low specificity compared with reference SDAs in FAERS. Conclusion Future research is needed to find better refinements of query data and/or the metrics to improve the specificity of these web query log algorithms.Keywords
Funding Information
- Sanofi
This publication has 19 references indexed in Scilit:
- Social Media Listening for Routine Post-Marketing Safety SurveillanceDrug Safety, 2016
- Social media and pharmacovigilance: A review of the opportunities and challengesBritish Journal of Clinical Pharmacology, 2015
- Utilizing social media data for pharmacovigilance: A reviewJournal of Biomedical Informatics, 2015
- ANALYZING SEARCH BEHAVIOR OF HEALTHCARE PROFESSIONALS FOR DRUG SAFETY SURVEILLANCE2014
- Text Mining for Adverse Drug Events: the Promise, Challenges, and State of the ArtDrug Safety, 2014
- Toward Enhanced Pharmacovigilance Using Patient-Generated Data on the InternetClinical Pharmacology & Therapeutics, 2014
- Performance of Pharmacovigilance Signal-Detection Algorithms for the FDA Adverse Event Reporting SystemClinical Pharmacology & Therapeutics, 2013
- Combing signals from spontaneous reports and electronic health records for detection of adverse drug reactionsJournal of the American Medical Informatics Association, 2012
- Comparative Performance of Two Quantitative Safety Signalling MethodsDrug Safety, 2006
- An appraisal of spontaneous adverse event monitoring.1992