Those Confounded Moderators in Meta-Analysis: Good, Bad, and Ugly
Author:
- 1 May 2003
- journal article
- research article
- Published by SAGE Publications in The Annals of the American Academy of Political and Social Science
- Vol. 587 (1) , 69-81
Abstract
One of the more revealing aspects of meta-analysis is the relationship between effect sizes and moderator variables representing differences among studies in their methods, samples, and interventions. However, interesting moderator variables are generally related to each other as well as to effect sizes. This confounding among moderator variables can make the results of any analysis focusing on a single moderator variable misleading. Despite the ambiguity of such results, this form of analysis is common in meta-analytic studies of intervention. The hazards and complexities of investigating and interpreting confounded moderator variables are illustrated in this article by the author's examining the difference in effect sizes associated with randomized versus nonrandomized designs in a large meta-analytic database of delinquency intervention studies.Keywords
This publication has 8 references indexed in Scilit:
- Does Research Design Affect Study Outcomes in Criminal Justice?The Annals of the American Academy of Political and Social Science, 2001
- Random versus nonrandom assignment in controlled experiments: Do you get the same answer?Journal of Consulting and Clinical Psychology, 1996
- Assignment methods in experimentation: When do nonrandomized experiments approximate answers from randomized experiments?Psychological Methods, 1996
- Child and adolescent psychotherapy outcomes in experiments versus clinics: Why the disparity?Journal of Abnormal Child Psychology, 1995
- Observational Studies1995
- The efficacy of psychological, educational, and behavioral treatment: Confirmation from meta-analysis.American Psychologist, 1993
- The lab versus the clinic: Effects of child and adolescent psychotherapy.American Psychologist, 1992
- Fitting Continuous Models to Effect Size DataJournal of Educational Statistics, 1982