Possible biases in observation systems when applied across contexts: conceptualizing, operationalizing, and sequencing instructional quality
Open Access
- 2 July 2022
- journal article
- research article
- Published by Springer Nature in Educational Assessment, Evaluation and Accountability
- Vol. 35 (1) , 105-128
Abstract
Capturing and measuring instructional patterns by using standardized observation manuals has become increasingly popular in classroom research. While researchers argue that a common vocabulary of teaching is necessary for the field of classroom research to move forward, instructional features vary across classrooms and contexts, which poses serious measuring challenges. In this article, we argue that potential biases embedded in observation systems have to be identified and addressed in order for interpretations of results across different classrooms and contexts to be valid and relevant. We identify three aspects of possible systematic biases (related to the grain size of conceptualization, operationalization, and sequencing of lessons) and how these may influence ratings of instructional quality when an established observation system (the Protocol for Language Arts Teaching Observations [PLATO]) is applied in the contexts of Nordic mathematics classrooms. We discuss implications of such possible biases and make suggestions for how they may be addressed.Keywords
Funding Information
- Norges Forskningsråd (222620/F10)
- University of Oslo
This publication has 49 references indexed in Scilit:
- When Rater Reliability Is Not EnoughEducational Researcher, 2012
- Attribution Error and the Quest for Teacher QualityEducational Researcher, 2010
- Teachers’ Mathematical Knowledge, Cognitive Activation in the Classroom, and Student ProgressAmerican Educational Research Journal, 2010
- Quality of geometry instruction and its short-term impact on students' understanding of the Pythagorean TheoremLearning and Instruction, 2009
- Mathematical Knowledge for Teaching and the Mathematical Quality of Instruction: An Exploratory StudyCognition and Instruction, 2008
- Back to the Future: Directions for Research in Teaching and Teacher EducationAmerican Educational Research Journal, 2008
- Effective classroom management and the development of subject-related interestLearning and Instruction, 2007
- The international system for Teacher Observation and Feedback: Evolution of an international study of teacher effectiveness constructsEducational Research and Evaluation, 2006
- On Two Metaphors for Learning and the Dangers of Choosing Just OneEducational Researcher, 1998
- Building Student Capacity for Mathematical Thinking and Reasoning: An Analysis of Mathematical Tasks Used in Reform ClassroomsAmerican Educational Research Journal, 1996