Large studies reveal how reference bias limits policy applications of self-report measures
Authors:
Open Access
- 10 November 2022
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 12 (1) , 1-12
Abstract
There is growing policy interest in identifying contexts that cultivate self-regulation. Doing so often entails comparing groups of individuals (e.g., from different schools). We show that self-report questionnaires—the most prevalent modality for assessing self-regulation—are prone to reference bias, defined as systematic error arising from differences in the implicit standards by which individuals evaluate behavior. In three studies, adolescents (N = 229,685) whose peers performed better academically rated themselves lower in self-regulation and held higher standards for self-regulation. This effect was not observed for task measures of self-regulation and led to paradoxical predictions of college persistence 6 years later. These findings suggest that standards for self-regulation vary by social group, limiting the policy applications of self-report questionnaires.Keywords
Funding Information
- Bill and Melinda Gates Foundation
- Raikes Foundation
- William T. Grant Foundation
- Center for Advanced Study in the Behavioral Sciences
- John Templeton Foundation
- Walton Family Foundation
This publication has 83 references indexed in Scilit:
- Yes, But Are They Happy? Effects of Trait Self‐Control on Affective Well‐Being and Life SatisfactionJournal of Personality, 2013
- Life Stress Impairs Self-Control in Early AdolescenceFrontiers in Psychology, 2013
- Young Adult Obesity and Household Income: Effects of Unconditional Cash TransfersAmerican Economic Journal: Applied Economics, 2013
- Who Does Well in Life? Conscientious Adults Excel in Both Objective and Subjective SuccessFrontiers in Psychology, 2012
- A meta-analysis of the convergent validity of self-control measuresJournal of Research in Personality, 2011
- A gradient of childhood self-control predicts health, wealth, and public safetyProceedings of the National Academy of Sciences, 2011
- Executive functions and school readiness intervention: Impact, moderation, and mediation in the Head Start REDI programDevelopment and Psychopathology, 2008
- The Big-fish–little-pond-effect Stands Up to Critical Scrutiny: Implications for Theory, Methodology, and Future ResearchEducational Psychology Review, 2008
- Adolescent DevelopmentAnnual Review of Psychology, 2001
- BEHAVIORALLY ANCHORED RATING SCALES: A REVIEW OF THE LITERATUREPersonnel Psychology, 1975