Generalizations and Extensions of the Probability of Superiority Effect Size Estimator
Authors:
- 1 March 2013
- journal article
- research article
- Published by Taylor & Francis in Multivariate Behavioral Research
- Vol. 48 (2) , 208-219
Abstract
Researchers are strongly encouraged to accompany the results of statistical tests with appropriate estimates of effect size. For 2-group comparisons, a probability-based effect size estimator (A) has many appealing properties (e.g., it is easy to understand, robust to violations of parametric assumptions, insensitive to outliers). We review generalizations of the A statistic to extend its use to applications with discrete data, with weighted data, with k > 2 groups, and with correlated samples. These generalizations are illustrated through reanalyses of data from published studies on sex differences in the acceptance of hypothetical offers of casual sex and in scores on a measure of economic enlightenment, on age differences in reported levels of Authentic Pride, and in differences between the numbers of promises made and kept in romantic relationships. Drawing from research on the construction of confidence intervals for the A statistic, we recommend a bootstrap method that can be used for each generalization of A. We provide a suite of programs that should make it easy to use the A statistic and accompany it with a confidence interval in a wide variety of research contexts.Keywords
This publication has 12 references indexed in Scilit:
- Effect Sizes for Research2012
- Perceived proposer personality characteristics and gender differences in acceptance of casual sex offers.Journal of Personality and Social Psychology, 2011
- Tracking the trajectory of shame, guilt, and pride across the life span.Journal of Personality and Social Psychology, 2010
- A probability-based measure of effect size: Robustness to base rates and other factors.Psychological Methods, 2008
- Biases of Success Rate Differences Shown in Binomial Effect Size Displays.Psychological Methods, 2004
- Comparing several robust tests of stochastic equality with ordinally scaled variables and small to moderate sized samples.Psychological Methods, 2002
- Practical Significance: A Concept Whose Time Has ComeEducational and Psychological Measurement, 1996
- Probability of the superior outcome of one treatment over another.Journal of Applied Psychology, 1994
- An Introduction to the Bootstrap1993
- A common language effect size statistic.Psychological Bulletin, 1992