Answer Similarity Analysis at the Group Level
Author:
- 25 May 2021
- journal article
- research article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 45 (5) , 299-314
Abstract
Answer similarity indices were developed to detect pairs of test takers who may have worked together on an exam or instances in which one test taker copied from another. For any pair of test takers, an answer similarity index can be used to estimate the probability that the pair would exhibit the observed response similarity or a greater degree of similarity under the assumption that the test takers worked independently. To identify groups of test takers with unusually similar response patterns, Wollack and Maynes suggested conducting cluster analysis using probabilities obtained from an answer similarity index as measures of distance. However, interpretation of results at the cluster level can be challenging because the method is sensitive to the choice of clustering procedure and only enables probabilistic statements about pairwise relationships. This article addresses these challenges by presenting a statistical test that can be applied to clusters of examinees rather than pairs. The method is illustrated with both simulated and real data.Keywords
This publication has 12 references indexed in Scilit:
- Hierarchical Decompositions for the Computation of High-Dimensional Multivariate Normal ProbabilitiesJournal of Computational and Graphical Statistics, 2018
- Estimating Orthant Probabilities of High-Dimensional Gaussian Vectors with An Application to Set EstimationJournal of Computational and Graphical Statistics, 2018
- Detecting excessive similarity in answers on multiple choice examsJournal of Applied Statistics, 2000
- Elements of Large-Sample Theory1999
- Numerical Computation of Multivariate Normal ProbabilitiesJournal of Computational and Graphical Statistics, 1992
- The Methods and Problems of Cluster Analysis1988
- Comparison of IRT True-Score and Equipercentile Observed-Score "Equatings"Applied Psychological Measurement, 1984
- Methods for Assessing Multivariate Normality1973
- Estimating Item Parameters and Latent Ability when Responses are Scored in Two or More Nominal CategoriesPsychometrika, 1972
- Contingency Tables Involving Small Numbers and the χ2 TestJournal of the Royal Statistical Society Series B: Statistical Methodology, 1934