Walter P. Vispoel
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Walter P. Vispoel has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Timothy Bleiler
State University of New York at Buffalo
5 shared publications - Tianyou Wang
ACT, Inc
3 shared publications - Damien Ihrig
The Connie Belin & Jacqueline N. Blank Center for Gifted Education and Talent Development The University of Iowa
1 shared publication - Jo M. Hendrickson
University of Iowa
1 shared publication - Kristi Hendrickson
Department of Communication Sciences and Disorders, The University of Iowa, Iowa City
1 shared publication Linan Sun
1 shared publication
Latest Publications
- 1 December 2002
- Published by Wiley in Journal of Educational Measurement
- Vol. 39 (4) , 311-330
Can Examinees Use Judgments of Item Difficulty to Improve Proficiency Estimates on Computerized Adaptive Vocabulary Tests?
- 1 December 2002
- Published by Wiley in Journal of Educational Measurement
- Vol. 39 (4) , 311-330
Can Examinees Use Judgments of Item Difficulty to Improve Proficiency Estimates on Computerized Adaptive Vocabulary Tests?
- 1 March 2000
- Published by Wiley in Journal of Educational Measurement
- Vol. 37 (1) , 21-38
Limiting Answer Review and Change on Computerized Adaptive Vocabulary Tests: Psychometric and Attitudinal Results
Previous simulation studies of computerized adaptive tests (CATs) have revealed that the validity and precision of proficiency estimates can be maintained when review opportunities are limited to items within successive blocks. Our purpose in this study was to evaluate the effectiveness of CATs with such restricted review options in a live testing setting. Vocabulary CATs were compared under four conditions: (a) no item review allowed, (b) review allowed only within successive 5‐item blocks, (c) review allowed only within successive lO‐item blocks, and (d) review allowed only after answering all 40 items. Results revealed no trust‐worthy differences among conditions in vocabulary proficiency estimates, measurement error, or testing time. Within each review condition, ability estimates and number correct scores increased slightly after review, more answers were changed from wrong to right than from right to wrong, most examinees who changed answers improved proficiency estimates by doing so, and nearly all examinees indicated that they had an adequate opportunity to review their previous answers. These results suggest that restricting review opportunities on CATs may provide a viable way to satisfy examinee desires, maintain validity and measurement precision, and keep testing time at acceptable levels.
- 1 March 2000
- Published by Wiley in Journal of Educational Measurement
- Vol. 37 (1) , 21-38
Limiting Answer Review and Change on Computerized Adaptive Vocabulary Tests: Psychometric and Attitudinal Results
Previous simulation studies of computerized adaptive tests (CATs) have revealed that the validity and precision of proficiency estimates can be maintained when review opportunities are limited to items within successive blocks. Our purpose in this study was to evaluate the effectiveness of CATs with such restricted review options in a live testing setting. Vocabulary CATs were compared under four conditions: (a) no item review allowed, (b) review allowed only within successive 5‐item blocks, (c) review allowed only within successive lO‐item blocks, and (d) review allowed only after answering all 40 items. Results revealed no trust‐worthy differences among conditions in vocabulary proficiency estimates, measurement error, or testing time. Within each review condition, ability estimates and number correct scores increased slightly after review, more answers were changed from wrong to right than from right to wrong, most examinees who changed answers improved proficiency estimates by doing so, and nearly all examinees indicated that they had an adequate opportunity to review their previous answers. These results suggest that restricting review opportunities on CATs may provide a viable way to satisfy examinee desires, maintain validity and measurement precision, and keep testing time at acceptable levels.
- 1 June 1999
- Published by Wiley in Journal of Educational Measurement
- Vol. 36 (2) , 141-157
Can Examinees Use a Review Option to Obtain Positively Biased Ability Estimates on a Computerized Adaptive Test?
Part of the controversy about allowing examinees to review and change answers to previous items on computerized adaptive tests (CATs) centers on a strategy for obtaining positively biased ability estimates attributed to Wainer (1993) in which examinees intentionally answer items incorrectly before review and to the best of their abilities upon review. Our results, based on both simulated and live testing data, showed that there were instances in which the Wainer strategy yielded inflated ability estimates as well as instances in which it yielded deflated ability estimates. The success of the strategy in inflating ability estimates depended on the ability estimation method used (maximum likelihood versus Bayesian), the examinee's true ability level, the standard error of the ability estimate, the examinee's ability to implement the strategy, and the type of decision made from the ability estimate. We discuss approaches to dealing with the Wainer strategy in operational CAT settings.
- 1 June 1999
- Published by Wiley in Journal of Educational Measurement
- Vol. 36 (2) , 141-157
Can Examinees Use a Review Option to Obtain Positively Biased Ability Estimates on a Computerized Adaptive Test?
Part of the controversy about allowing examinees to review and change answers to previous items on computerized adaptive tests (CATs) centers on a strategy for obtaining positively biased ability estimates attributed to Wainer (1993) in which examinees intentionally answer items incorrectly before review and to the best of their abilities upon review. Our results, based on both simulated and live testing data, showed that there were instances in which the Wainer strategy yielded inflated ability estimates as well as instances in which it yielded deflated ability estimates. The success of the strategy in inflating ability estimates depended on the ability estimation method used (maximum likelihood versus Bayesian), the examinee's true ability level, the standard error of the ability estimate, the examinee's ability to implement the strategy, and the type of decision made from the ability estimate. We discuss approaches to dealing with the Wainer strategy in operational CAT settings.
- 1 December 1998
- Published by Wiley in Journal of Educational Measurement
- Vol. 35 (4) , 328-345
Reviewing and Changing Answers on Computer‐adaptive and Self‐adaptive Vocabulary Tests
Results obtained from computer‐adaptive and self‐adaptive tests were compared under conditions in which item review was permitted and not permitted. Comparisons of answers before and after review within the “review” condition showed that a small percentage of answers was changed (5.23%), that more answers were changed from wrong to right than from right to wrong (by a ratio of 2.92:1), that most examinees (66.5%) changed answers to at least some questions, that most examinees who changed answers improved their ability estimates by doing so (by a ratio of 2.55 to 1), and that review was particularly beneficial to examineees at high ability levels. Comparisons between the “review” and “no‐review” conditions yielded no significant differences in ability estimates or in estimated measurement error and provided no trustworthy evidence that test anxiety moderated the effects of review on those indexes. Most examinees desired review, but permitting it increased testing time by 41%.
- 1 December 1998
- Published by Wiley in Journal of Educational Measurement
- Vol. 35 (4) , 328-345
Reviewing and Changing Answers on Computer‐adaptive and Self‐adaptive Vocabulary Tests
Results obtained from computer‐adaptive and self‐adaptive tests were compared under conditions in which item review was permitted and not permitted. Comparisons of answers before and after review within the “review” condition showed that a small percentage of answers was changed (5.23%), that more answers were changed from wrong to right than from right to wrong (by a ratio of 2.92:1), that most examinees (66.5%) changed answers to at least some questions, that most examinees who changed answers improved their ability estimates by doing so (by a ratio of 2.55 to 1), and that review was particularly beneficial to examineees at high ability levels. Comparisons between the “review” and “no‐review” conditions yielded no significant differences in ability estimates or in estimated measurement error and provided no trustworthy evidence that test anxiety moderated the effects of review on those indexes. Most examinees desired review, but permitting it increased testing time by 41%.
- 1 June 1998
- Published by Wiley in Journal of Educational Measurement
- Vol. 35 (2) , 155-167
Psychometric Characteristics of Computer‐Adaptive and Self‐Adaptive Vocabulary Tests: The Role of Answer Feedback and Test Anxiety
- 1 June 1998
- Published by Wiley in Journal of Educational Measurement
- Vol. 35 (2) , 155-167
Psychometric Characteristics of Computer‐Adaptive and Self‐Adaptive Vocabulary Tests: The Role of Answer Feedback and Test Anxiety
- 1 June 1998
- Published by Wiley in Journal of Educational Measurement
- Vol. 35 (2) , 109-135
Properties of Ability Estimation Methods in Computerized Adaptive Testing
- 1 June 1998
- Published by Wiley in Journal of Educational Measurement
- Vol. 35 (2) , 109-135
Properties of Ability Estimation Methods in Computerized Adaptive Testing
- 1 March 1997
- Published by Wiley in Journal of Educational Measurement
- Vol. 34 (1) , 43-63
Computerized Adaptive and Fixed‐Item Testing of Music Listening Skill: A Comparison of Efficiency, Precision, and Concurrent Validity
We evaluated the efficiency, precision, and concurrent validity of results obtained from adaptive and fired‐item music listening tests in three studies: (a) a computer simulation study in which each of 2,200 simulees completed a computerized adaptive tonal memory test, a computerized fired‐item tonal memory test constructed from items in the adaptive test pool and two standardized group‐administered tonal memory tests; (b) a live testing study in which each of 204 examinees took the computerized adaptive test and the standardized tests; and (c) a live testing study in which randomly equivalent groups took either the computerized adaptive test (n = 86) or the computerized fired‐item test (n = 86). The adaptive music test required 50% to 93% fewer items to match the reliability and concurrent validity of the fired‐item tests, and it yielded higher levels of reliability and concurrent validity than the fired‐item tests when test length was held constant. These findings suggest that computerized adaptive tests, which typically have been limited to visually produced items, may also be well suited for measuring skills that require aurally produced items.
- 1 March 1997
- Published by Wiley in Journal of Educational Measurement
- Vol. 34 (1) , 43-63
Computerized Adaptive and Fixed‐Item Testing of Music Listening Skill: A Comparison of Efficiency, Precision, and Concurrent Validity
We evaluated the efficiency, precision, and concurrent validity of results obtained from adaptive and fired‐item music listening tests in three studies: (a) a computer simulation study in which each of 2,200 simulees completed a computerized adaptive tonal memory test, a computerized fired‐item tonal memory test constructed from items in the adaptive test pool and two standardized group‐administered tonal memory tests; (b) a live testing study in which each of 204 examinees took the computerized adaptive test and the standardized tests; and (c) a live testing study in which randomly equivalent groups took either the computerized adaptive test (n = 86) or the computerized fired‐item test (n = 86). The adaptive music test required 50% to 93% fewer items to match the reliability and concurrent validity of the fired‐item tests, and it yielded higher levels of reliability and concurrent validity than the fired‐item tests when test length was held constant. These findings suggest that computerized adaptive tests, which typically have been limited to visually produced items, may also be well suited for measuring skills that require aurally produced items.