Small Sample Sizes and a False Economy for Psychiatric Clinical Trials
Authors:
- 1 July 2019
- journal article
- editorial
- Published by American Medical Association (AMA) in JAMA Psychiatry
- Vol. 76 (7) , 676-677
Abstract
In 2013, JAMA Psychiatry published an exciting new finding by Hallak et al1: patients with schizophrenia who were treated with a single infusion of the antihypertensive agent sodium nitroprusside showed a dramatic, instantaneous, and sustained improvement in psychotic and negative symptoms. The study by Hallak et al1 was not only double-blind, randomized, and placebo-controlled, but the authors had also presented a prospective power analysis, ensured good interrater reliability, and reported all the relevant aspects of the trial. Understandably, this study generated tremendous excitement and several attempts were made to replicate the finding. In this issue of JAMA Psychiatry, Brown et al2 report an equally systematic study that fails to replicate the original finding. In fact, the findings by Brown et al2 join those of 2 other prior studies3,4 that also failed to replicate the original finding. A careful analysis of the competing studies fails to reveal an obvious explanation for this discrepancy—except that the original finding was based on a rather small sample of just 10 patients per treatment arm.Keywords
This publication has 10 references indexed in Scilit:
- Sodium nitroprusside treatment for psychotic symptoms and cognitive deficits of schizophrenia: A randomized, double-blind, placebo-controlled trialPsychiatry Research, 2018
- Low statistical power in biomedical science: a review of three human research domainsRoyal Society Open Science, 2017
- Current Incentives for Scientists Lead to Underpowered Studies with Erroneous ConclusionsPLOS Biology, 2016
- The effect of sodium nitroprusside on psychotic symptoms and spatial working memory in patients with schizophrenia: a randomized, double-blind, placebo-controlled trialPsychological Medicine, 2016
- Replication and contradiction of highly cited research papers in psychiatry: 10-year follow-upThe British Journal of Psychiatry, 2015
- Rapid Improvement of Acute Schizophrenia Symptoms After Intravenous Sodium NitroprussideJAMA Psychiatry, 2013
- Minimum Clinically Important Difference in the Positive and Negative Syndrome Scale With Data From the Clinical Antipsychotic Trials of Intervention Effectiveness (CATIE)The Journal of Clinical Psychiatry, 2012
- Putting the efficacy of psychiatric and general medicine medication into perspective: review of meta-analysesThe British Journal of Psychiatry, 2012
- How effective are second-generation antipsychotic drugs? A meta-analysis of placebo-controlled trialsMolecular Psychiatry, 2008
- Why Most Published Research Findings Are FalsePLOS Medicine, 2005