Establishing new cutoffs for Cohen's d: An application using known effect sizes from trials for improving sleep quality on composite mental health
Open Access
- 25 April 2023
- journal article
- research article
- Published by Wiley in International Journal of Methods in Psychiatric Research
- Vol. 32 (3) , e1969
Abstract
Objective: Cohen's d conventional effect size cutoffs [small (0.2), medium (0.5), and large (0.8)] might not be representative of the reported distribution of effect sizes across the different areas of health. Effect size cutoffs might vary not only depending on the area of research, but also on the type of intervention and population. That is, they are context dependent. Therefore, we present strategies to redefine small, medium, and large effect size based on 25, 50, and 75th percentile, respectively.Methods: We illustrate these techniques applying them to 72 effect sizes, derived from 65 randomized controlled trials described in a recent meta‐analysis (10.1016/j.smrv.2021.101556) of improving sleep quality on composite mental health. Such percentiles are equally distanced from the average effect size as suggested by Jacob Cohen and checked for potential attenuation effects (via weight selection model) and outliers (via OutRules).Results: new cutoffs for effect size distribution of −0.177, −0.329, and −0.557, for small, medium, and large effect size were found, respectively. applying Cohen's effect size thresholds (0.2, 0.5, and 0.8) for trials of improving sleep quality on composite mental health might over‐estimate effect sizes compared to the real‐world context, especially around medium and large effect sizes.Keywords
This publication has 12 references indexed in Scilit:
- Improving sleep quality leads to better mental health: A meta-analysis of randomised controlled trialsSleep Medicine Reviews, 2021
- Sleep disturbance and psychiatric disordersThe Lancet Psychiatry, 2020
- How to Identify and Fix Sleep ProblemsJAMA Psychiatry, 2020
- Prenatal Risk Factors and the Etiology of ADHD—Review of Existing EvidenceCurrent Psychiatry Reports, 2017
- Statistical considerations for reporting and planning heart rate variability case‐control studiesPsychophysiology, 2016
- Statistical Power Analysis for the Behavioral Sciences2013
- A Brief Primer on Effect SizesJournal of Teaching in Physical Education, 2009
- A General Linear Model for Estimating Effect Size in the Presence of Publication BiasPsychometrika, 1995
- A power primer.Psychological Bulletin, 1992
- A Heteroskedasticity-Consistent Covariance Matrix Estimator and a Direct Test for HeteroskedasticityEconometrica, 1980