Assessing English Learners' Progress: Longitudinal Invariance of a Standards-Based Classroom Assessment of English Proficiency
Author:
- 1 October 2012
- journal article
- research article
- Published by Taylor & Francis in Language Assessment Quarterly
- Vol. 9 (4) , 331-347
Abstract
Assessing and monitoring student progress is becoming increasingly important in classrooms and for accountability purposes. Yet, in order to interpret changes in assessment results from one year to the next as reflecting differences in underlying ability rather than as variations in the measurement, the assessments used should be measuring the same constructs over time. Gathering evidence of an assessment's longitudinal invariance is particularly important when the assessments used are based on teacher judgments because teacher judgments are often viewed as inconsistent, and different teachers may be involved each year. This study examined the extent to which a standards-based classroom assessment based on teacher judgments measures English proficiency consistently over time by examining its longitudinal invariance using confirmatory factor analysis. Results indicate that the English Language Development Classroom Assessment measures the same overall construct of English proficiency in Grades 2, 3, and 4: Invariance was established for the overall factor structure of the assessment. However, only partial invariance was established for the first- and second-order factor loadings. These findings suggest that, when the focus is overall language proficiency, teacher judgments could be used to make meaningful determinations of student progress from one year to the next.Keywords
This publication has 33 references indexed in Scilit:
- Concurrent and Separate Grade-Groups Linking Procedures for Vertical ScalingApplied Measurement in Education, 2008
- Distorting Value Added: The Use of Longitudinal, Vertically Scaled Student Achievement Data for Growth-Based, Value-Added AccountabilityJournal of Educational and Behavioral Statistics, 2006
- Evaluating Goodness-of-Fit Indexes for Testing Measurement InvarianceStructural Equation Modeling: A Multidisciplinary Journal, 2002
- Outcomes-based assessment in practice: some examples and emerging insightsLanguage Testing, 2001
- Snares and silver bullets: disentangling the construct of formative assessmentLanguage Testing, 2000
- Measurement Error, Multidimensionality, and Scale Shrinkage: A Reply to Yen and BurketJournal of Educational Measurement, 1999
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Investigating the effects of strategy use and second language test performance with high- and low-ability test takers: a structural equation modelling approachLanguage Testing, 1998
- Outcomes-based assessment and reporting in language learning programmes: a review of the issuesLanguage Testing, 1998
- Longitudinal measurement models in evaluation research: Examining stability and changeEvaluation and Program Planning, 1996