A Shadow-Test Approach to Adaptive Item Calibration
Open Access
- 1 June 2020
- journal article
- research article
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 85 (2) , 301-321
Abstract
A shadow-test approach to the calibration of field-test items embedded in adaptive testing is presented. The objective function used in the shadow-test model selects both the operational and field-test items adaptively using a Bayesian version of the criterion of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} $$D_{\mathrm{s}}$$ -optimality. The constraint set for the model can be used to hide the field-test items completely in the content of the test as well as to deal with such practical issues as random control of their exposure rates. The approach runs on efficient implementations of the Gibbs sampler for the real-time updating of the ability and field-test parameters. Optimal settings for the proposed algorithms were found and used to demonstrate item calibration with smaller than traditional sample sizes in runtimes fully comparable with conventional adaptive testing.
Keywords
Funding Information
- University of Twente
This publication has 13 references indexed in Scilit:
- A Fast and Simple Algorithm for Bayesian Adaptive TestingJournal of Educational and Behavioral Statistics, 2019
- Handbook of Item Response Theory, Three Volume Set2018
- Continuous Online Item Calibration: Parameter Recovery and Item UtilizationPsychometrika, 2017
- Optimal Bayesian Adaptive Design for Test-Item CalibrationPsychometrika, 2015
- Applied Integer Programming2009
- Nonlinear sequential designs for logistic item response theory models with applications to computerized adaptive testsThe Annals of Statistics, 2009
- Linear Models for Optimal Test Design2005
- A Model for Optimal Constrained Adaptive TestingApplied Psychological Measurement, 1998
- Markov Chain Monte Carlo in Practice.Journal of the American Statistical Association, 1997
- Inference from Iterative Simulation Using Multiple SequencesStatistical Science, 1992