Hypothetico‐Deductive Reasoning in Direct Oral Anticoagulant Trial Meta‐Analyses: A Meta‐Epidemiological Study
Open Access
- 13 November 2026
- journal article
- research article
- Published by Wiley in Fundamental & Clinical Pharmacology
- Vol. 40 (6) , e70118
Abstract
Background: Direct oral anticoagulants (DOAC) have become standard therapy for thrombosis prevention since 2008. Meta‐analyses (MAs) of randomized controlled trials (RCT) are considered high‐level evidence supporting clinical guidelines. However, methodological biases may yield false‐positive findings, particularly through inadequate hypothesis formulation, multiple testing without alpha‐risk correction, and selective outcome reporting. No study has systematically assessed the risk of false positives in MA evaluating DOAC through hypothetico‐deductive reasoning. Objective: This study aimed to assess methodological features relevant to confirmatory inference in MA of RCTs evaluating DOACs, including hypothesis specification and multiplicity management, and to quantify nominal exposure to type I error under specified assumptions. Methods: Following a pre‐specified protocol, we conducted a meta‐epidemiological study using embase and PubMed databases. We included MA of RCT evaluating four EMA‐approved DOAC. Two independent authors performed study selection. For each MA, we calculated the nominal family‐wise probability of at least one type I error under the global null hypothesis, assuming independent tests. We assessed the presence of directional hypotheses, primary outcome definition, pre‐specified protocols, sensitivity analyses, and spin in conclusions. Results: Ninety‐three MA were included (mean 34 118 patients; seven RCT per MA). The median nominal family‐wise type I error probability was 40%, and only 2.2% of MAs reported alpha‐risk management, 26.9% had pre‐specified protocols, and 14.0% reported directional hypotheses. Only 5.4% combined a clearly specified directional hypothesis with a single primary objective and well‐defined outcome. Spin was present in 30.1% of conclusions. Conclusion: Most MAs showed substantial uncorrected nominal exposure to multiplicity; this estimate is a theoretical indicator and not the probability that a published conclusion is false. Many MAs also lacked explicit hypotheses and frequently exhibited spin. Strengthening reliability requires integrating genuine hypothetico‐deductive approaches and adapting methodological guidelines.Keywords
This publication has 33 references indexed in Scilit:
- Most Systematic Reviews and Meta‐analyses Reporting Clinical Outcomes of the Remplissage Procedure Have at Least 1 Form of SpinArthroscopy, Sports Medicine, and Rehabilitation, 2024
- Antithrombotic Therapy for VTE DiseaseChest, 2021
- Over 30% of Systematic Reviews and Meta‐analyses Focused on Rotator Cuff Tear Treatments Contained Spin in the AbstractArthroscopy, 2021
- Evaluation of spin in the abstracts of systematic reviews and meta-analyses on breast cancer treatment, screening, and quality of life outcomes: A cross-sectional studyJournal of Cancer Policy, 2021
- Oral Anticoagulant Prescription Trends, Profile Use, and Determinants of Adherence in Patients with Atrial FibrillationPharmacotherapy: The Journal of Human Pharmacology and Drug Therapy, 2019
- Trends and Variation in Oral Anticoagulant Choice in Patients with Atrial Fibrillation, 2010–2017Pharmacotherapy: The Journal of Human Pharmacology and Drug Therapy, 2018
- A new classification of spin in systematic reviews and meta-analyses was developed and ranked according to the severityJournal of Clinical Epidemiology, 2016
- Bonferroni‐based correction factor for multiple, correlated endpointsPharmaceutical Statistics, 2012
- Reporting and Interpretation of Randomized Controlled Trials With Statistically Nonsignificant Results for Primary OutcomesJAMA, 2010
- Are All Significant P Values Created Equal?JAMA, 1987