The Effects of Type I Error Rate and Power of the ANCOVA F Test and Selected Alternatives Under Nonnormality and Variance Heterogeneity
Authors:
- 1 January 2001
- journal article
- research article
- Published by Taylor & Francis in The Journal of Experimental Education
- Vol. 69 (4) , 373-391
Abstract
The authors sought to identify through Monte Carlo simulations those conditions for which analysis of covariance (ANCOVA) does not maintain adequate Type I error rates and power. The conditions that were manipulated included assumptions of normality and variance homogeneity, sample size, number of treatment groups, and strength of the covariate-dependent variable relationship. Alternative tests studied were Quade's procedure, Puri and Sen's solution, Burnett and Barr's rank difference scores, Conover and Iman's rank transformation test, Hettmansperger's procedure, and the Puri-Sen-Harwell-Serlin test. For balanced designs, the ANCOVA F test was robust and was often the most powerful test through all sample-size designs and distributional configurations. With unbalanced designs, with variance heterogeneity, and when the largest treatment-group variance was matched with the largest group sample size, the nonparametric alternatives generally outperformed the ANCOVA test. When sample size and variance ratio were inversely coupled, all tests became very liberal; no test maintained adequate control over Type I error.Keywords
This publication has 21 references indexed in Scilit:
- Analysis of Covariance: A Proposed AlgorithmEducational and Psychological Measurement, 1993
- A Nonparametric Test Statistic for the General Linear ModelJournal of Educational Statistics, 1989
- An empirical study of a proposed test of nonparametric analysis of covariance.Psychological Bulletin, 1988
- Parametric ANCOVA and the Rank Transform ANCOVA When the Data Are Conditionally Non-Normal and HeteroscedasticJournal of Educational Statistics, 1984
- Another look at ANCOVA versus blocking.Psychological Bulletin, 1984
- A Method for Simulating Non-Normal DistributionsPsychometrika, 1978
- Robustness?British Journal of Mathematical and Statistical Psychology, 1978
- A Nonparametric Analogy of Analysis of CovarianceEducational and Psychological Measurement, 1977
- The Reporting of Computation-Based Results in StatisticsThe American Statistician, 1975
- A Note on the Generation of Random Normal DeviatesThe Annals of Mathematical Statistics, 1958