Defining Error Rates and Power for Detecting Answer Copying
- 1 December 2001
- journal article
- research article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 25 (4) , 385-404
Abstract
A family wise approach is described for evaluating the significance of copying indices designed to hold the Type I error rate constant for each examinee. The empirical Type I error rate and power of two indices, ω (Wollack, 1997) and g2 (Frary, Tideman, & Watts, 1977), are examined under a variety of copying situations. Results indicated that the traditional pairwise approach falsely detected examinees almost three times more often than the nominal α level. Familywise Type I error rates were substantially smaller, although they also tended to be somewhat inflated at small α levels as the percentage of items copied increased. Eliminating the indices detecting a source from the copier, in situations where the copier was also detected from the source, helped control the familywise Type I error rates for all α .001. Lack of Type I error control meant power could not be evaluated for g2 under any of the simulated familywise conditions. Familywise power for ω was reasonable when at least 30% of the items were copied.Keywords
This publication has 10 references indexed in Scilit:
- Detection of Answer Copying with Unknown Item and Trait ParametersApplied Psychological Measurement, 1998
- A Nominal Response Model Approach for Detecting Answer CopyingApplied Psychological Measurement, 1997
- New developments in pairwise multiple comparisons: Some powerful and practicable procedures.Psychological Bulletin, 1991
- Detection of Cheating on Multiple-Choice Tests by Using Error-Similarity AnalysisTeaching of Psychology, 1989
- A sharper Bonferroni procedure for multiple tests of significanceBiometrika, 1988
- Marginal Maximum Likelihood Estimation of Item Parameters: Application of an EM AlgorithmPsychometrika, 1981
- Indices of Cheating on Multiple-Choice TestsJournal of Educational Statistics, 1977
- The Development of Statistical Indices for Detecting CheatersJournal of the American Statistical Association, 1974
- Multiple Comparisons among MeansJournal of the American Statistical Association, 1961
- The $\chi^2$ Test of Goodness of FitThe Annals of Mathematical Statistics, 1952