Simulating computerized adaptive testing in special education based on inclusive progress monitoring data
Authors:
Open Access
- 23 November 2022
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Education
- Vol. 7
Abstract
Introduction: Adaptive tests have advantages especially for children with special needs but are rarely used in practice. Therefore, we have investigated for our web-based progress-monitoring platform www.levumi.de of how to build adaptive tests based on existing item pools by computerized adaptive testing (CAT). In this study, we explore the requirements of item pools and necessary settings of computerized adaptive testing in special education and inclusion in order to achieve both short test length and good test accuracy.Methods: We used existing items fitted to the Rasch model and data samples of progress monitoring tests (N = 681) for mathematics and reading to create two item pools for adaptive testing. In a simulation study (N = 4,000), we compared different test lengths and test accuracies as stopping rules with regard to an inclusive use of adaptive testing.Results: The results show an optimal maximum test length of 37 and 24 items, with a target standard error for accuracy of 0.5. These results correspond to an average execution time of about 3 min per test.Discussion: The results are discussed in terms of the use of adaptive testing in inclusive settings and the applicability of such adaptive tests as screenings, focusing mainly on students with special needs in learning, language, or behavior.Keywords
This publication has 39 references indexed in Scilit:
- Wann sollten computerbasierte Verfahren zur Messung von Kompetenzen anstelle von papier- und bleistift-basierten Verfahren eingesetzt werden?Zeitschrift für Erziehungswissenschaft, 2013
- Accuracy of teachers' judgments of students' academic achievement: A meta-analysis.Journal of Educational Psychology, 2012
- Computerized classification testing with the Rasch modelEducational Research and Evaluation, 2011
- Item Selection Rules in Computerized Adaptive TestingMethodology, 2009
- Implementation of Response to InterventionJournal of Learning Disabilities, 2008
- Oral Reading Fluency Norms: A Valuable Assessment Tool for Reading TeachersThe Reading Teacher, 2006
- Computerized Adaptive Testing: Overview and IntroductionApplied Psychological Measurement, 1999
- Operational Characteristics of Adaptive Testing Procedures Using the Graded Response ModelApplied Psychological Measurement, 1989
- Adaptive testing by computer.Journal of Consulting and Clinical Psychology, 1985
- Statistical theory for logistic mental test models with a prior distribution of abilityJournal of Mathematical Psychology, 1969