Construct validity in cross-cultural, developmental research: challenges and strategies for improvement
Authors:
- Nicole J. WenNWNicole J. Wen
- Dorsa AmirDADorsa Amir
- Jennifer M. CleggJCJennifer M. Clegg
- Helen E. DavisHDHelen E. Davis
- Natalia B. DutraNDNatalia B. Dutra
- Michelle A. KlineMKMichelle A. Kline
- Sheina Lew-LevySLSheina Lew-Levy
- Gairan PameiGPGairan Pamei
- Yitong WangYWYitong Wang
- Jing XuJXJing Xu
- Bruce S. RawlingsBRBruce S. Rawlings
Top Cited Papers
Open Access
- 21 February 2025
- journal article
- research article
- Published by Cambridge University Press (CUP) in Evolutionary Human Sciences
- Vol. 7, e17
Abstract
The recent expansion of cross-cultural research in the social sciences has led to increased discourse on methodological issues involved when studying culturally diverse populations. However, discussions have largely overlooked the challenges of construct validity – ensuring instruments are measuring what they are intended to – in diverse cultural contexts, particularly in developmental research. We contend that cross-cultural developmental research poses distinct problems for ensuring high construct validity owing to the nuances of working with children, and that the standard approach of transporting protocols designed and validated in one population to another risks low construct validity. Drawing upon our own and others’ work, we highlight several challenges to construct validity in the field of cross-cultural developmental research, including (1) lack of cultural and contextual knowledge, (2) dissociating developmental and cultural theory and methods, (3) lack of causal frameworks, (4) superficial and short-term partnerships and collaborations, and (5) culturally inappropriate tools and tests. We provide guidelines for addressing these challenges, including (1) using ethnographic and observational approaches, (2) developing evidence-based causal frameworks, (3) conducting community-engaged and collaborative research, and (4) the application of culture-specific refinements and training. We discuss the need to balance methodological consistency with culture-specific refinements to improve construct validity in cross-cultural developmental research.Keywords
This publication has 99 references indexed in Scilit:
- Cultural Values Underlying Psychometric Cognitive TestingNeuropsychology Review, 2005
- Synchrony in the Onset of Mental-State ReasoningPsychological Science, 2005
- A Structural Approach to Selection BiasEpidemiology, 2004
- The Concept of Validity.Psychological Review, 2004
- Cultural Pathways Through Universal DevelopmentAnnual Review of Psychology, 2003
- The importance of pilot studiesNursing Standard, 2002
- The nature of adolescent competencies predicted by preschool delay of gratification.Journal of Personality and Social Psychology, 1988
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959
- Factors relevant to the validity of experiments in social settings.Psychological Bulletin, 1957
- Construct validity in psychological tests.Psychological Bulletin, 1955