Metrics Matter
Authors:
- 15 March 2016
- journal article
- research article
- Published by SAGE Publications in Educational Administration Quarterly
- Vol. 52 (3) , 423-462
Abstract
Purpose: Supporting teachers’ use of data has become a large part of educational leaders’ instructional leadership. Drawing on sensemaking theory, we explore how features of data and teachers’ perceptions of them may matter when teachers consider student learning data. Design: The article draws on a 1-year, comparative case study of five low-income, high needs middle schools in three districts. Data sources include interviews with district leaders ( n = 13); school administrators, coaches, and case study teachers ( n = 73); focus groups ( n = 6) with non–case study teachers ( n = 24); observations ( n = 20); web-based activity logs; and document review. Findings: Different forms of data lead to a wide range of instructional responses. State assessments, used largely at the beginning of the school year, aided teachers in grouping their students but did little to promote change in instructional delivery. District benchmark data, which teachers did not generally find useful, were associated with reteaching and retesting content, creating small groups, and having students reflect on their data, usually without a shift in pedagogy. Data from common grade assessments—valued for their closeness to instruction as well as their predictive information for future success on state assessments—were most often tied to regrouping or reteaching standards not yet mastered by students, but there was some promise of change in pedagogy. Classroom assessment results and student work, identified by teachers as very useful, were proportionately most often linked to changes in instructional delivery. Implications: We offer implications for leadership preparation and practice, education policy, and future research on data use.Keywords
This publication has 72 references indexed in Scilit:
- A Systemic View of Implementing Data Literacy in Educator PreparationEducational Researcher, 2013
- Strategic FramingEducational Policy, 2012
- A Perfect Time for Data Use: Using Data-Driven Decision Making to Inform PracticeEducational Psychologist, 2012
- Garbage In, Garbage Out: Having Useful Data Is EverythingMeasurement: Interdisciplinary Research and Perspectives, 2011
- Research on Data Use: A Framework and AnalysisMeasurement: Interdisciplinary Research and Perspectives, 2011
- Teacher Learning, Instructional Considerations and Principal Communication: Lessons from a Longitudinal Study of Collaborative Data Use by TeachersEducational Management Administration & Leadership, 2011
- Knowledge Exchange Processes in Organizations and Policy Arenas: A Narrative Systematic Review of the LiteratureThe Milbank Quarterly, 2010
- Research on Evaluation UseAmerican Journal of Evaluation, 2009
- Assessment and Classroom LearningAssessment in Education: Principles, Policy & Practice, 1998
- Quantifying Qualitative Analyses of Verbal Data: A Practical GuideJournal of the Learning Sciences, 1997