A Nominal Response Model Approach for Detecting Answer Copying
Author:
- 1 December 1997
- journal article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 21 (4) , 307-320
Abstract
When examinees copy answers to test questions from other examinees, the validity of the test is compromised. Most available statistical procedures for detecting copying were developed out of classical test theory (CrT); hence, they suffer from sampledependent score and item statistics, and biased estimates of the expected number of answer matches between a pair of examinees. Item response theory (IRT) based procedures alleviate these problems; however, because they fail to compare the similarity of responses between neighboring examinees, they have relatively poor power for detecting copiers. A new IRT-based test statistic, wo, was compared with the best CUT-based index g 2 under various copying conditions, amounts of copying, test lengths, and sample sizes. w consistently held the Type I error rate at or below the nominal level; g 2 yielded substantially inflated Type I error rates. The power of w varied as a function of both test length and the percentage of items copied. w demonstrated good power to detect copiers, provided that at least 20% of the items were copied on an 80-item test and at least 30% were copied on a 40-item test. Based on these results, with regard to both Tbype I error rate and power, c appears to be more useful than g 2 as a copying index.Keywords
This publication has 13 references indexed in Scilit:
- Social Accounts and Metaphors about CheatingCollege Teaching, 1994
- Statistical Detection of Multiple-Choice Answer Copying: Review and CommentaryApplied Measurement in Education, 1993
- New developments in pairwise multiple comparisons: Some powerful and practicable procedures.Psychological Bulletin, 1991
- Detection of Cheating on Multiple-Choice Tests by Using Error-Similarity AnalysisTeaching of Psychology, 1989
- Improved estimation of academic cheating behavior using the randomized response techniqueResearch in Higher Education, 1987
- Appropriateness measurement with polychotomous item response models and standardized indicesBritish Journal of Mathematical and Statistical Psychology, 1985
- Measuring the Appropriateness of Multiple-Choice Test ScoresJournal of Educational Statistics, 1979
- Indices of Cheating on Multiple-Choice TestsJournal of Educational Statistics, 1977
- The Development of Statistical Indices for Detecting CheatersJournal of the American Statistical Association, 1974
- College cheating as a function of subject and situational variables.Journal of Educational Psychology, 1964