Misuse of the P Value
- 1 March 2024
- journal article
- research article
- Published by Wolters Kluwer Health in Dimensions of Critical Care Nursing
- Vol. 43 (2) , 96-101
Abstract
Introduction: Quantitative research and quality improvement (QI) both seek to improve care provided to patients. However, clinicians often blur the lines between how to appropriately analyze data from these methodologies. Clinicians may inappropriately use statistical analyses for QI initiatives, rather than using run and statistical process control (SPC) charts to analyze improvements in outcomes. Objective: The purpose of this article was to address the analytic methods used for QI initiatives in the clinical setting in an effort to show clinicians how to identify meaningful improvements in clinical practice. Methods: In this article, we provide an example comparing the same evidence-based practice/QI initiative (chlorhexidine gluconate bathing in a medical intensive care unit) using a quasi-experimental pretest/posttest research design with statistical analyses completed with t tests with analyses using run and SPC charts to show the data trended over time. Using a pretest/posttest design, chlorhexidine gluconate bathing compliance improved from 63% to 65%, a nonsignificant change, P = .075. These same data plotted on run and SPC charts, however, show a shift and a trend, indicating clinically significant improvements per QI methodologies. Conclusion: The example in this article highlights the pitfall of relying only on statistical analyses and P values to determine the importance of a clinical project, and provides a practical example for how run or SPC charts can be used to identify improvements over time.Keywords
This publication has 14 references indexed in Scilit:
- Letter to the editorNursing Outlook, 2022
- Results of the CHlorhexidine Gluconate Bathing implementation intervention to improve evidence-based nursing practices for prevention of central line associated bloodstream infections Study (CHanGing BathS): a stepped wedge cluster randomized trialImplementation Science, 2021
- Considering Evidence From Studies With Findings Beyond the Sacred Cow of p < .05 for Best PracticeWorldviews on Evidence-Based Nursing, 2020
- Six Simple Steps to Sustainability: A Checklist for Ongoing Monitoring of Clinical Practice ImprovementsAACN Advanced Critical Care, 2020
- Moving nursing beyond p < 0.05Research in Nursing & Health, 2019
- The reign of the p -value is over: what alternative analyses could we employ to fill the power vacuum?Biology Letters, 2019
- The P Value and Statistical Significance: Misunderstandings, Explanations, Challenges, and AlternativesIndian Journal of Psychological Medicine, 2019
- Introduction to quality improvement tools for the clinicianJournal of Perinatology, 2018
- P Values: From Suggestion to SuperstitionJournal of Investigative Medicine, 2016
- Accountability Measures — Using Measurement to Promote Quality ImprovementNew England Journal of Medicine, 2010