Accuracy in parameter estimation for ANCOVA and ANOVA contrasts: Sample size planning via narrow confidence intervals
Authors:
- 17 October 2011
- journal article
- research article
- Published by Wiley in British Journal of Mathematical and Statistical Psychology
- Vol. 65 (2) , 350-370
Abstract
Contrasts of means are often of interest because they describe the effect size among multiple treatments. High‐quality inference of population effect sizes can be achieved through narrow confidence intervals (CIs). Given the close relation between CI width and sample size, we propose two methods to plan the sample size for an ANCOVA or ANOVA study, so that a sufficiently narrow CI for the population (standardized or unstandardized) contrast of interest will be obtained. The standard method plans the sample size so that the expected CI width is sufficiently small. Since CI width is a random variable, the expected width being sufficiently small does not guarantee that the width obtained in a particular study will be sufficiently small. An extended procedure ensures with some specified, high degree of assurance (e.g., 90% of the time) that the CI observed in a particular study will be sufficiently narrow. We also discuss the rationale and usefulness of two different ways to standardize an ANCOVA contrast, and compare three types of standardized contrast in the ANCOVA/ANOVA context. All of the methods we propose have been implemented in the freely available MBESS package in R so that they can be easily applied by researchers.Keywords
This publication has 47 references indexed in Scilit:
- Sample size and the width of the confidence interval for mean differenceBritish Journal of Mathematical and Statistical Psychology, 2009
- Sample Size Planning for the Squared Multiple Correlation Coefficient: Accuracy in Parameter Estimation via Narrow Confidence IntervalsMultivariate Behavioral Research, 2008
- Sample Size Planning for Statistical Power and Accuracy in Parameter EstimationAnnual Review of Psychology, 2008
- Sample size planning for the standardized mean difference: Accuracy in parameter estimation via narrow confidence intervals.Psychological Methods, 2006
- Sample Size for Multiple Regression: Obtaining Regression Coefficients That Are Accurate, Not Simply Significant.Psychological Methods, 2003
- The Advantages of Using Standardized Scores in Causal AnalysisHuman Communication Research, 2002
- Power and money: Designing statistically powerful studies while minimizing financial costs.Psychological Methods, 1997
- Optimal design in psychological research.Psychological Methods, 1997
- The earth is round (p < .05).American Psychologist, 1994
- Alternative Ways of Assessing Model FitSociological Methods & Research, 1992