Wim J. van der Linden
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Wim J. van der Linden has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Seung Ma Choi
University of Texas at Austin, Austin, USA
3 shared publications Bingnan Jiang
ACT, Inc., Iowa City, USA
1 shared publication- Hao Ren
Pearson, Austin, USA
1 shared publication Jie Li
McGraw‐Hill Education
1 shared publicationMaomi Ueno
University of Electro-Communications, Tokyo, Japan
1 shared publicationMichelle D. Barrett
Pacific Metrics Corporation, 1 Lower Ragsdale Bldg. 1 Ste 150, Monterey, CA, 93940 , USA
1 shared publication
Latest Publications
- Open Access
- 23 July 2024
- Published by Wiley in Journal of Educational Measurement
- Vol. 61 (4) , 624-633
On the Choice of Parameters for the Lognormal Model for Response Times: Commentary on Becker et al. (2013)
In a recently published article in this journal, Becker et al. claim that, because of a missing slope parameter, the lognormal model for response times on test items almost never holds in practice. However, the authors' critique rests on a misrepresentation of the model, which already does have the equivalent of a slope parameter. More importantly, their extra parameter spoils the interpretation of the parameters for the test‐takers' speed and labor intensity of the items necessary for a response‐time model to be empirically meaningful while their proposed interpretation of the extra parameter seems unwarranted. An analysis of the authors' earlier empirical comparison between the original and their alternative version of the model does not seem to support much of a conclusion about the relative fit of the two models. Also, their simulation study conducted to demonstrate the necessity of the extra slope parameter appears to be based on data simulated in favor of their parameter.
- 23 July 2024
- Published by Wiley in Journal of Educational Measurement
- Vol. 61 (4) , 624-633
Open AccessOn the Choice of Parameters for the Lognormal Model for Response Times: Commentary on Becker et al. (2013)
In a recently published article in this journal, Becker et al. claim that, because of a missing slope parameter, the lognormal model for response times on test items almost never holds in practice. However, the authors' critique rests on a misrepresentation of the model, which already does have the equivalent of a slope parameter. More importantly, their extra parameter spoils the interpretation of the parameters for the test‐takers' speed and labor intensity of the items necessary for a response‐time model to be empirically meaningful while their proposed interpretation of the extra parameter seems unwarranted. An analysis of the authors' earlier empirical comparison between the original and their alternative version of the model does not seem to support much of a conclusion about the relative fit of the two models. Also, their simulation study conducted to demonstrate the necessity of the extra slope parameter appears to be based on data simulated in favor of their parameter.
- 30 June 2022
- Published by Springer Nature in Behaviormetrika
- Vol. 49 (2) , 165-167
Special issue: shadow-test approach to adaptive testing
- 30 June 2022
- Published by Springer Nature in Behaviormetrika
- Vol. 49 (2) , 165-167
Special issue: shadow-test approach to adaptive testing
- Open Access
- 11 May 2022
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 47 (4) , 485-504
Two Statistical Tests for the Detection of Item Compromise
Two independent statistical tests of item compromise are presented, one based on the test takers’ responses and the other on their response times (RTs) on the same items. The tests can be used to monitor an item in real time during online continuous testing but are also applicable as part of post hoc forensic analysis. The two test statistics are simple intuitive quantities as the sum of the responses and RTs observed for the test takers on the item. Common features of the tests are ease of interpretation and computational simplicity. Both tests are uniformly most powerful under the assumption of known ability and speed parameters for the test takers. Examples of power functions for items with realistic parameter values suggest maximum power for 20–30 test takers with item preknowledge for the response-based test and 10–20 test takers for the RT-based test.
- 11 May 2022
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 47 (4) , 485-504
Open AccessTwo Statistical Tests for the Detection of Item Compromise
Two independent statistical tests of item compromise are presented, one based on the test takers’ responses and the other on their response times (RTs) on the same items. The tests can be used to monitor an item in real time during online continuous testing but are also applicable as part of post hoc forensic analysis. The two test statistics are simple intuitive quantities as the sum of the responses and RTs observed for the test takers on the item. Common features of the tests are ease of interpretation and computational simplicity. Both tests are uniformly most powerful under the assumption of known ability and speed parameters for the test takers. Examples of power functions for items with realistic parameter values suggest maximum power for 20–30 test takers with item preknowledge for the response-based test and 10–20 test takers for the RT-based test.
- Open Access
- 12 September 2021
- Published by Springer Nature in Behaviormetrika
- Vol. 49 (2) , 169-190
Review of the shadow-test approach to adaptive testing
Constrained adaptive testing is reviewed as an instance of discrete maximization with the shadow-test approach delivering its solution. The approach may look counterintuitive in that it assumes sequential assembly of full test forms as its basic operation. But it always produces real-time solutions that are optimal and satisfy the set of specifications in effect for the test. Equally importantly, it can be used to run testing programs with different degrees of adaptation for the same set of specifications and/or as a tool to manage programs with simultaneous processes as adaptive item calibration, time management, and/or item-security monitoring.
- 12 September 2021
- Published by Springer Nature in Behaviormetrika
- Vol. 49 (2) , 169-190
Open AccessReview of the shadow-test approach to adaptive testing
Constrained adaptive testing is reviewed as an instance of discrete maximization with the shadow-test approach delivering its solution. The approach may look counterintuitive in that it assumes sequential assembly of full test forms as its basic operation. But it always produces real-time solutions that are optimal and satisfy the set of specifications in effect for the test. Equally importantly, it can be used to run testing programs with different degrees of adaptation for the same set of specifications and/or as a tool to manage programs with simultaneous processes as adaptive item calibration, time management, and/or item-security monitoring.
- 17 August 2021
- Published by Springer Nature in Behaviormetrika
- Vol. 49 (2) , 191-229
TestDesign: an optimal test design approach to constructing fixed and adaptive tests in R
- 17 August 2021
- Published by Springer Nature in Behaviormetrika
- Vol. 49 (2) , 191-229
TestDesign: an optimal test design approach to constructing fixed and adaptive tests in R
- Open Access
- 1 June 2020
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 85 (2) , 301-321
A Shadow-Test Approach to Adaptive Item Calibration
A shadow-test approach to the calibration of field-test items embedded in adaptive testing is presented. The objective function used in the shadow-test model selects both the operational and field-test items adaptively using a Bayesian version of the criterion of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} $$D_{\mathrm{s}}$$ -optimality. The constraint set for the model can be used to hide the field-test items completely in the content of the test as well as to deal with such practical issues as random control of their exposure rates. The approach runs on efficient implementations of the Gibbs sampler for the real-time updating of the ability and field-test parameters. Optimal settings for the proposed algorithms were found and used to demonstrate item calibration with smaller than traditional sample sizes in runtimes fully comparable with conventional adaptive testing.- 1 June 2020
- Published by Cambridge University Press (CUP) in Psychometrika
- Vol. 85 (2) , 301-321
Open AccessA Shadow-Test Approach to Adaptive Item Calibration
A shadow-test approach to the calibration of field-test items embedded in adaptive testing is presented. The objective function used in the shadow-test model selects both the operational and field-test items adaptively using a Bayesian version of the criterion of \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} $$D_{\mathrm{s}}$$ -optimality. The constraint set for the model can be used to hide the field-test items completely in the content of the test as well as to deal with such practical issues as random control of their exposure rates. The approach runs on efficient implementations of the Gibbs sampler for the real-time updating of the ability and field-test parameters. Optimal settings for the proposed algorithms were found and used to demonstrate item calibration with smaller than traditional sample sizes in runtimes fully comparable with conventional adaptive testing. - Open Access
- 21 May 2020
- Published by Springer Nature in Behaviormetrika
- Vol. 47 (2) , 427-449
Bayesian adaptive testing with polytomous items
An extremely efficient MCMC method for Bayesian adaptive testing with polytomous items is explained both conceptually and in mathematical detail. Results from extensive simulation studies with different item pools, polytomous response models, calibration sample sizes, and test lengths are presented. In addition, the case of adaptive testing from pools with a mixture of dichotomous and polytomous items is addressed.
- 21 May 2020
- Published by Springer Nature in Behaviormetrika
- Vol. 47 (2) , 427-449
Open AccessBayesian adaptive testing with polytomous items
An extremely efficient MCMC method for Bayesian adaptive testing with polytomous items is explained both conceptually and in mathematical detail. Results from extensive simulation studies with different item pools, polytomous response models, calibration sample sizes, and test lengths are presented. In addition, the case of adaptive testing from pools with a mixture of dichotomous and polytomous items is addressed.
- 30 September 2019
- Published by Wiley in Journal of Educational Measurement
- Vol. 57 (3) , 405-422
Improving Item‐Exposure Control in Adaptive Testing
One of the methods of controlling test security in adaptive testing is imposing random item‐ineligibility constraints on the selection of the items with probabilities automatically updated to maintain a predetermined upper bound on the exposure rates. Three major improvements of the method are presented. First, a few modifications to improve the initialization of the method and accelerate the impact of its feedback mechanism on the observed item‐exposure rates are introduced. Second, the case of conditional item‐exposure control given the uncertainty of examinee's ability parameter is addressed. Third, although rare for a well‐designed item pool, when applied in combination with the shadow‐test approach to adaptive testing the method may meet occasional infeasibility of the shadow‐test model. A big M method is proposed that resolves the issue. The practical advantages of the improvements are illustrated using simulated adaptive testing from a real‐world item pool under a variety of conditions.
- 30 September 2019
- Published by Wiley in Journal of Educational Measurement
- Vol. 57 (3) , 405-422
Improving Item‐Exposure Control in Adaptive Testing
One of the methods of controlling test security in adaptive testing is imposing random item‐ineligibility constraints on the selection of the items with probabilities automatically updated to maintain a predetermined upper bound on the exposure rates. Three major improvements of the method are presented. First, a few modifications to improve the initialization of the method and accelerate the impact of its feedback mechanism on the observed item‐exposure rates are introduced. Second, the case of conditional item‐exposure control given the uncertainty of examinee's ability parameter is addressed. Third, although rare for a well‐designed item pool, when applied in combination with the shadow‐test approach to adaptive testing the method may meet occasional infeasibility of the shadow‐test model. A big M method is proposed that resolves the issue. The practical advantages of the improvements are illustrated using simulated adaptive testing from a real‐world item pool under a variety of conditions.
- 24 March 2019
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 44 (4) , 415-430
Lord’s Equity Theorem Revisited
Lord’s (1980) equity theorem claims observed-score equating to be possible only when two test forms are perfectly reliable or strictly parallel. An analysis of its proof reveals use of an incorrect statistical assumption. The assumption does not invalidate the theorem itself though, which can be shown to follow directly from the discrete nature of the equating problem it addresses. But, surprisingly, an obvious relaxation of the problem is enough to obtain exactly the opposite result: As long as two test forms measure the same ability, they can always be equated, no matter their reliability, degree of parallelness, or even difference in length. Also, in spite of its lack of validity, the original proof of Lord’s theorem has an important interim result directly applicable to the problem of assembling a new test form pre-equated to an old form.
- 24 March 2019
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 44 (4) , 415-430
Lord’s Equity Theorem Revisited
Lord’s (1980) equity theorem claims observed-score equating to be possible only when two test forms are perfectly reliable or strictly parallel. An analysis of its proof reveals use of an incorrect statistical assumption. The assumption does not invalidate the theorem itself though, which can be shown to follow directly from the discrete nature of the equating problem it addresses. But, surprisingly, an obvious relaxation of the problem is enough to obtain exactly the opposite result: As long as two test forms measure the same ability, they can always be equated, no matter their reliability, degree of parallelness, or even difference in length. Also, in spite of its lack of validity, the original proof of Lord’s theorem has an important interim result directly applicable to the problem of assembling a new test form pre-equated to an old form.
- 1 December 2018
- Published by Wiley in Journal of Educational Measurement
- Vol. 55 (4) , 435-456
A Comparison of Constraint Programming and Mixed‐Integer Programming for Automated Test‐Form Generation
- 1 December 2018
- Published by Wiley in Journal of Educational Measurement
- Vol. 55 (4) , 435-456
A Comparison of Constraint Programming and Mixed‐Integer Programming for Automated Test‐Form Generation