Efficiently exploring the causal role of contextual moderators in behavioral science
Open Access
- 28 December 2022
- journal article
- research article
- Published by National Academy of Sciences in Proceedings of the National Academy of Sciences
- Vol. 120 (1)
Abstract
Behavioral science interventions have the potential to address longstanding policy problems, but their effects are typically heterogeneous across contexts (e.g., teachers, schools, and geographic regions). This contextual heterogeneity is poorly understood, however, which reduces the field’s impact and its understanding of mechanisms. Here, we present an efficient way to interrogate heterogeneity and address these gaps in knowledge. This method a) presents scenarios that vividly represent different moderating contexts, b) measures a short-term behavioral outcome (e.g., an academic choice) that is known to relate to typical intervention outcomes (e.g., academic achievement), and c) assesses the causal effect of the moderating context on the link between the psychological variable typically targeted by interventions and this short-term outcome. We illustrated the utility of this approach across four experiments (total n = 3,235) that directly tested contextual moderators of the links between growth mindset, which is the belief that ability can be developed, and students’ academic choices. The present results showed that teachers’ growth mindset-supportive messages and the structural opportunities they provide moderated the link between students’ mindsets and their choices (studies 1 to 3). This pattern was replicated in a nationally representative sample of adolescents and did not vary across demographic subgroups (study 2), nor was this pattern the result of several possible confounds (studies 3 to 4). Discussion centers on how this method of interrogating contextual heterogeneity can be applied to other behavioral science interventions and broaden their impact in other policy domains.Keywords
Funding Information
- National Science Foundation (1761179)
- HHS | National Institutes of Health (R01HD084772)
- HHS | National Institutes of Health (P2CHD042849)
- National Science Foundation (2004831)
- National Science Foundation (0818839)
This publication has 52 references indexed in Scilit:
- Parent Praise to 1- to 3-Year-Olds Predicts Children's Motivational Frameworks 5 Years LaterChild Development, 2013
- Mindsets That Promote Resilience: When Students Believe That Personal Characteristics Can Be DevelopedEducational Psychologist, 2012
- The Role of Application Assistance and Information in College Decisions: Results from the H&R Block Fafsa Experiment*The Quarterly Journal of Economics, 2012
- Social norms and energy conservationJournal of Public Economics, 2011
- Motivating voter turnout by invoking the selfProceedings of the National Academy of Sciences, 2011
- Social-Psychological Interventions in EducationReview of Educational Research, 2011
- Recursive Processes in Self-Affirmation: Intervening to Close the Minority Achievement GapScience, 2009
- Subtle Linguistic Cues Affect Children's MotivationPsychological Science, 2007
- Reducing the Racial Achievement Gap: A Social-Psychological InterventionScience, 2006
- Mindless statisticsThe Journal of Socio-Economics, 2004