Validating Automated Measures of Text Complexity
- 1 August 2017
- journal article
- Published by Wiley in Educational Measurement: Issues and Practice
- Vol. 36 (4) , 35-43
Abstract
Automated text complexity measurement tools (also called readability metrics) have been proposed as a way to help teachers, textbook publishers, and assessment developers select texts that are closely aligned with the new, more demanding text complexity expectations specified in the Common Core State Standards. This article examines a critical element of the validity arguments presented in support of proposed metrics: the claim that criterion text complexity scores developed from students’ responses to reading comprehension test items are reflective of the difficulties actually experienced by students while reading. Evidence that fails to support this assertion is examined, and implications relative to the goal of obtaining valid, unbiased evidence about the measurement properties of proposed readability metrics are discussed.Keywords
This publication has 18 references indexed in Scilit:
- Challenging the Research Base of the Common Core State StandardsEducational Researcher, 2013
- Validating the Interpretations and Uses of Test ScoresJournal of Educational Measurement, 2013
- The Common Core State Standards’ Quantitative Text Complexity TrajectoryEducational Researcher, 2013
- Causal Rasch modelsFrontiers in Psychology, 2013
- Upping the Ante of Text Complexity in the Common Core State StandardsEducational Researcher, 2013
- Reconstructing Readability: Recent Developments and Recommendations in the Analysis of Text DifficultyEducational Psychology Review, 2011
- A Text Readability Continuum for Postsecondary ReadinessJournal of Advanced Academics, 2008
- Cultures de production, de distribution et de consommation en milieu urbain en Angleterre, 1100-1350Histoire urbaine, 2006
- How to Equate Tests With Little or No DataJournal of Educational Measurement, 1993
- Estimating Population Characteristics From Sparse Matrix Samples of Item ResponsesJournal of Educational Measurement, 1992