Assessment in the Time of COVID-19: Understanding Patterns of Student Disengagement during Remote Low-Stakes Testing
Authors:
- 3 April 2022
- journal article
- research article
- Published by Taylor & Francis in Educational Assessment
- Vol. 27 (2) , 136-151
Abstract
The arrival of the COVID-19 pandemic had a profound effect on K-12 education. Most schools transitioned to remote instruction, and some used remote testing to assess student learning. Remote testing, however, is less controlled than in-school testing, leading to concerns regarding test-taking engagement. This study compared the disengagement of students remotely administered an adaptive interim assessment in spring 2020 with their disengagement on the assessment administered in-school during fall 2019. Results showed that disengagement gradually increased across grade level. This pattern was not meaningfully different between the two testing contexts, with the exception of results for American Indian/Alaska Native students, who showed higher disengagement under remote testing. In addition, the test’s engagement feature – which automatically paused the test event of a disengaged student and notified the test proctor – had a consistently positive impact whether the proctor was in the same room as the student or proctoring was done remotely.Keywords
This publication has 19 references indexed in Scilit:
- Online Proctored Versus Unproctored Low-Stakes Internet Test Administration: Is There Differential Test-Taking Behavior and Performance?American Journal of Distance Education, 2017
- Modeling Student Test‐Taking Motivation in the Context of an Adaptive Achievement TestJournal of Educational Measurement, 2016
- Effort Analysis: Individual Score Validation of Achievement Test DataApplied Measurement in Education, 2015
- Growth and gaps in mathematics achievement of students with and without disabilities on a statewide achievement testJournal of School Psychology, 2015
- Cheating, Reactions, and Performance in Remotely Proctored Testing: An Exploratory Experimental StudyJournal of Business and Psychology, 2014
- Modeling Item‐Position Effects Within an IRT FrameworkJournal of Educational Measurement, 2013
- Correlates of Rapid-Guessing Behavior in Low-Stakes Testing: Implications for Test Development and Measurement PracticeApplied Measurement in Education, 2009
- Taking the Time to Improve the Validity of Low‐Stakes Tests: The Effort‐Monitoring CBTEducational Measurement: Issues and Practice, 2006
- Response Time Effort: A New Measure of Examinee Motivation in Computer-Based TestsApplied Measurement in Education, 2005
- Low Examinee Effort in Low-Stakes Assessment: Problems and Potential SolutionsEducational Assessment, 2005