Statistical Inference When Classroom Quality is Measured With Error
Authors:
- 9 April 2008
- journal article
- research article
- Published by Taylor & Francis in Journal of Research on Educational Effectiveness
- Vol. 1 (2) , 138-154
Abstract
A dramatic shift in research priorities has recently produced a large number of ambitious randomized trials in K-12 education. In most cases, the aim is to improve student academic learning by improving classroom instruction. Embedded in these studies are theories about how the quality of classroom must improve if these interventions are to succeed. The problem of measuring classroom quality then emerges as a major concern. This article first considers how errors of measurement reduce statistical power in studies of the impact of interventions classroom quality. We show how to use information about reliability to compute power and plan new research. At the same time, errors of measurement introduce bias into estimates of the association between classroom quality and student outcomes. We show how to use knowledge about the magnitude of measurement error to eliminate or reduce this bias. We also briefly review research on the design of studies of the reliability of classroom measures. Such studies are essential to evaluate promising new classroom interventions.Keywords
This publication has 7 references indexed in Scilit:
- Using Teacher Logs to Measure the Enacted Curriculum: A Study of Literacy Teaching in Third‐Grade ClassroomsThe Elementary School Journal, 2004
- Subgroup Analysis in Social Experiments: Measuring Program Impacts Based on Post-Treatment ChoiceAmerican Journal of Evaluation, 2003
- Using Video Surveys to Compare Classrooms and Teaching Across Cultures: Examples and Lessons From the TIMSS Video StudiesEducational Psychologist, 2000
- Statistical power and optimal design for multisite randomized trials.Psychological Methods, 2000
- 1. Ecometrics: Toward a Science of Assessing Ecological Settings, with Application to the Systematic Social Observation of NeighborhoodsSociological Methodology, 1999
- Statistical analysis and optimal design for cluster randomized trials.Psychological Methods, 1997
- Teachers' communication of differential expectations for children's classroom performance: Some behavioral data.Journal of Educational Psychology, 1970