An Introduction to Equivalence Testing in Jamovi for Nonsignificant Results in Speech, Language, and Hearing Research
- 12 August 2025
- journal article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 68 (8) , 4094-4105
Abstract
Purpose: Evidence-based data analysis methods are crucial in clinical and translational research areas, including speech-language pathology and audiology. Although commonly used, null hypothesis significance testing (NHST) is limited with regards to the conclusions that can be drawn from results, particularly nonsignificant findings. Equivalence testing can be used to complement NHST and imply the presence of an effect large enough to be considered as meaningful. This tutorial provides an introduction to equivalence testing using jamovi, a free graphics-based statistics package that allows researchers to conduct a wide range of statistical analyses, including equivalence testing, in a clear and easy-to-interpret manner. Method and Results: Simulated examples of equivalence testing of independent-samples t tests, paired-samples t tests, and correlations were conducted in jamovi, with explanations and justifications of choosing the smallest effect size of interest and analysis options provided and statistical output explained and interpreted. These examples also demonstrate what equivalence testing can and cannot infer about a data set. Conclusions: Analyses of nonsignificant results, through the use of equivalence testing, are underutilized in speech, language, and hearing research. By complementing traditional NHST analyses with equivalence testing, researchers can directly test for the presence (or absence) of an observed effect large enough that may be considered meaningful, and therefore test for both statistical significance and practical/clinical significance, which allows researchers to draw more informative conclusions from their findings and provide clearer information for clinicians and researchers in the field.Keywords
This publication has 50 references indexed in Scilit:
- Empirically derived guidelines for effect size interpretation in social psychologyEuropean Journal of Social Psychology, 2021
- Novel Effect Size Interpretation Guidelines and an Evaluation of Statistical Power in Rehabilitation ResearchArchives of Physical Medicine and Rehabilitation, 2020
- P > .05: The incorrect interpretation of “not significant” results is a significant problemAmerican Journal of Physical Anthropology, 2020
- Clinical Performance Evaluation of a Personal Sound Amplification Product vs a Basic Hearing Aid and a Premium Hearing AidJAMA Otolaryngology–Head & Neck Surgery, 2019
- Personal Sound Amplification Products vs a Conventional Hearing Aid for Speech Understanding in NoiseJAMA, 2017
- Negative results are disappearing from most disciplines and countriesScientometrics, 2011
- Understanding Equivalence and Noninferiority TestingJournal of General Internal Medicine, 2010
- Reporting of Noninferiority and Equivalence Randomized TrialsJAMA, 2006
- A comparison of the Two One-Sided Tests Procedure and the Power Approach for assessing the equivalence of average bioavailabilityJournal of Pharmacokinetics and Biopharmaceutics, 1987
- A new statistical procedure for testing equivalence in two-group comparative bioavailability trialsJournal of Pharmacokinetics and Biopharmaceutics, 1984