Item Pocket Method to Allow Response Review and Change in Computerized Adaptive Testing
Author:
- 30 January 2013
- journal article
- research article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 37 (4) , 259-275
Abstract
Most computerized adaptive testing (CAT) programs do not allow test takers to review and change their responses because it could seriously deteriorate the efficiency of measurement and make tests vulnerable to manipulative test-taking strategies. Several modified testing methods have been developed that provide restricted review options while limiting the trade-off in CAT efficiency. The extent to which these methods provided test takers with options to review test items, however, still was quite limited. This study proposes the item pocket (IP) method, a new testing approach that allows test takers greater flexibility in changing their responses by eliminating restrictions that prevent them from moving across test sections to review their answers. A series of simulations were conducted to evaluate the robustness of the IP method against various manipulative test-taking strategies. Findings and implications of the study suggest that the IP method may be an effective solution for many CAT programs when the IP size and test time limit are properly set.Keywords
This publication has 14 references indexed in Scilit:
- SimulCATApplied Psychological Measurement, 2012
- A Closer Look at Using Judgments of Item Difficulty to Change Answers on Computerized Adaptive TestsJournal of Educational Measurement, 2005
- Can Examinees Use Judgments of Item Difficulty to Improve Proficiency Estimates on Computerized Adaptive Vocabulary Tests?Journal of Educational Measurement, 2002
- Limiting Answer Review and Change on Computerized Adaptive Vocabulary Tests: Psychometric and Attitudinal ResultsJournal of Educational Measurement, 2000
- Reviewing and Changing Answers on Computer‐adaptive and Self‐adaptive Vocabulary TestsJournal of Educational Measurement, 1998
- Revising Item Responses in Computerized Adaptive Tests: A Comparison of Three ModelsApplied Psychological Measurement, 1997
- Computerized Adaptive Testing With Different GroupsEducational Measurement: Issues and Practice, 1992
- The Effect of Review on Student Ability and Test Efficiency for Computerized Adaptive TestsApplied Psychological Measurement, 1992
- TECHNICAL GUIDELINES FOR ASSESSING COMPUTERIZED ADAPTIVE TESTSJournal of Educational Measurement, 1984
- Staying with Initial Answers on Objective Tests: Is it a Myth?Teaching of Psychology, 1984