Causal inference in educational effectiveness research: a comparison of three methods to investigate effects of homework on student achievement1
- 28 June 2013
- journal article
- research article
- Published by Taylor & Francis in School Effectiveness and School Improvement
- Vol. 24 (3) , 275-295
Abstract
In educational effectiveness research, it frequently has proven difficult to make credible inferences about cause and effect relations. The article first identifies the main categories of threats to valid causal inference from observational data, and discusses designs and analytic approaches which protect against them. With the use of data from 22 countries which participated both in the Trends in International Mathematics and Science Study (TIMSS) 2003 and TIMSS 2008 with samples of Grade 8 students, 3 different methods are then applied to investigate effects of amount of time spent on homework on mathematics achievement: (a) 2-level regression, which is applied to separate student-level relations from class-level relations; (b) instrumental variables regression, using teacher-reported homework time to instrument student-reported homework time; and (c) a difference-in-differences analysis investigating country-level change between 2003 and 2007. All 3 methods showed that there is a positive effect of homework time on student achievement.Keywords
This publication has 21 references indexed in Scilit:
- Teachers’ Mathematical Knowledge, Cognitive Activation in the Classroom, and Student ProgressAmerican Educational Research Journal, 2010
- The relationship between homework time and achievement is not universal: evidence from multilevel analyses in 40 countriesSchool Effectiveness and School Improvement, 2009
- Alternative Approaches to Evaluation in Empirical MicroeconomicsThe Journal of Human Resources, 2009
- Does Homework Improve Academic Achievement? A Synthesis of Research, 1987–2003Review of Educational Research, 2006
- American Education Research Changes TackOxford Review of Economic Policy, 2004
- Homework and Student Math Achievement in Junior High SchoolsEducational Research and Evaluation, 2000
- Structural Equations with Latent Variables1989
- Homework.1989
- Alternative Methods for Solving the Problem of Selection Bias in Evaluating the Impact of Treatments on Outcomes1986
- Sample Selection Bias as a Specification ErrorEconometrica, 1979