Effect of Observation Mode on Measures of Secondary Mathematics Teaching
- 30 April 2013
- journal article
- research article
- Published by SAGE Publications in Educational and Psychological Measurement
- Vol. 73 (5) , 757-783
Abstract
Classroom observation of teachers is a significant part of educational measurement; measurements of teacher practice are being used in teacher evaluation systems across the country. This research investigated whether observations made live in the classroom and from video recording of the same lessons yielded similar inferences about teaching. Using scores on the Classroom Assessment Scoring System–Secondary (CLASS-S) from 82 algebra classrooms, we explored the effect of observation mode on inferences about the level or ranking of teaching in a single lesson or in a classroom for a year. We estimated the correlation between scores from the two observation modes and tested for mode differences in the distribution of scores, the sources of variance in scores, and the reliability of scores using generalizability and decision studies for the latter comparisons. Inferences about teaching in a classroom for a year were relatively insensitive to observation mode. However, time trends in the raters’ use of the score scale were significant for two CLASS-S domains, leading to mode differences in the reliability and inferences drawn from individual lessons. Implications for different modes of classroom observation with the CLASS-S are discussed.Keywords
This publication has 25 references indexed in Scilit:
- An Argument Approach to Observation Protocol ValidityEducational Assessment, 2012
- The Pivotal Role of Adolescent Autonomy in Secondary School ClassroomsJournal of Youth and Adolescence, 2011
- An Interaction-Based Approach to Enhancing Secondary School Instruction and Student AchievementScience, 2011
- Early Care and Education Quality and Child Outcomes2009
- Can Instructional and Emotional Support in the First-Grade Classroom Make a Difference for Children at Risk of School Failure?Child Development, 2005
- Categorical Data Analysis2002
- Generalizability Theory2001
- Video Portfolio Assessment: Creating a Framework for Viewing the Functions of TeachingEducational Assessment, 1998
- An Introduction to the Bootstrap1993
- OCCURRENCE AND GENERALIZABILITY OF SCORES ON A CLASSROOM INTERACTION INSTRUMENTJournal of Educational Measurement, 1979