The Generalizability of Motivation Filtering in Improving Test Score Validity
Authors:
- Vicki L. WiseVWVicki L. Wise
- Steven L. WiseSWSteven L. Wise
- Dennison S. BholaDBDennison S. Bhola
- 1 February 2006
- journal article
- Published by Taylor & Francis in Educational Assessment
- Vol. 11 (1) , 65-83
Abstract
Accountability for educational quality is a priority at all levels of education. Low-stakes testing is one way to measure the quality of education that students receive and make inferences about what students know and can do. Aggregate test scores from low-stakes testing programs are suspect, however, to the degree that these scores are influenced by low test-taker effort. This study examined the generalizability of a recently developed technique called motivation filtering, whereby scores for students of low motivation are systemically filtered from test data to determine aggregate test scores that more accurately reflect student performance and that can be used for reporting purposes. Across assessment tests in five different content areas, motivation filtering was found to consistently increase mean test performance and convergent validity.Keywords
This publication has 8 references indexed in Scilit:
- Response Time Effort: A New Measure of Examinee Motivation in Computer-Based TestsApplied Measurement in Education, 2005
- Low Examinee Effort in Low-Stakes Assessment: Problems and Potential SolutionsEducational Assessment, 2005
- Construct‐Irrelevant Variance in High‐Stakes TestingEducational Measurement: Issues and Practice, 2004
- An exploration of the psychology of the examinee: Can examinee self-regulation and test-taking motivation predict consequential and non-consequential test performance?Contemporary Educational Psychology, 2004
- ACT Research Report Series: Student Effort and Performance on a Measure of Postsecondary Educational Development1996
- Consequence of Performance, Test, Motivation, and Mentally Taxing ItemsApplied Measurement in Education, 1995
- The Consequence of Consequence: Motivation, Anxiety, and Test PerformanceApplied Measurement in Education, 1995
- Methods for comparing outcomes assessment instrumentsResearch in Higher Education, 1989