Outlier Detection in High‐Stakes Certification Testing
Author:
- 1 September 2002
- journal article
- Published by Wiley in Journal of Educational Measurement
- Vol. 39 (3) , 219-233
Abstract
Recent developrnents of person‐Jit analysis in computerized adaptive testing (CAT) are discussed. Methods from stutistical process control are presented that have been proposed to classify an item score pattern as fitting or misjitting the underlying item response theory model in CAT. Most person‐fit research in CAT is restricted to simulated data. In this study, empirical data from a certification test were used, Alternatives are discussed to generate norms so that bounds can be determined to classify an item score pattern as fitting or misfitting. Using bounds determined from a sample of a high‐stakes certification test, the empirical analysis showed that dizerent types of misfit can be distinguished. Further applications using statistical process control methods to detect misfitting item score patterns are discussed.Keywords
This publication has 22 references indexed in Scilit:
- CUSUM-Based Person-Fit Statistics for Adaptive TestingJournal of Educational and Behavioral Statistics, 2001
- Methodology Review: Evaluating Person FitApplied Psychological Measurement, 2001
- The Null Distribution of Person-Fit Statistics for Conventional and Adaptive TestsApplied Psychological Measurement, 1999
- Bayesian Identification of Outliers in Computerized Adaptive TestsJournal of the American Statistical Association, 1998
- Bayesian Identification of Outliers in Computerized Adaptive TestsJournal of the American Statistical Association, 1998
- The Distribution of Indexes of Person Fit within the Computerized Adaptive Testing EnvironmentApplied Psychological Measurement, 1997
- Optimal Identification of Mismeasured IndividualsApplied Measurement in Education, 1996
- Optimal Detection of Certain Forms of Inappropriate Test ScoresApplied Psychological Measurement, 1986
- Measuring the Appropriateness of Multiple-Choice Test ScoresJournal of Educational Statistics, 1979
- CONTINUOUS INSPECTION SCHEMESBiometrika, 1954