A Primer to (Cross-Cultural) Multi-Group Invariance Testing Possibilities in R
Authors:
Top Cited Papers
Open Access
- 18 July 2019
- journal article
- research article
- Published by Frontiers Media SA in Frontiers in Psychology
- Vol. 10, 1507
Abstract
Psychology has become less WEIRD in recent years, marking progress toward becoming a truly global psychology. However, this increase in cultural diversity is not matched by greater attention to cultural biases in research. A significant challenge in culture-comparative research in psychology is that any comparisons are open to possible item bias and non-invariance. Unfortunately, many psychologists are not aware of problems and their implications, and do not know how to best test for invariance in their data. We provide a general introduction to invariance testing and a tutorial of three major classes of techniques that can be easily implemented in the free software and statistical language R. Specifically, we describe (1) confirmatory and multi-group confirmatory factor analysis, with extension to exploratory structural equation modeling, and multi-group alignment; (2) iterative hybrid logistic regression as well as (3) exploratory factor analysis and principal component analysis with Procrustes rotation. We pay specific attention to effect size measures of item biases and differential item function. Code in R is provided in the main text and online (see https://osf.io/agr5e/), and more extended code and a general introduction to R are available in the Supplementary Materials.Keywords
This publication has 60 references indexed in Scilit:
- Effect size indices for analyses of measurement equivalence: Understanding the practical importance of differences between groups.Journal of Applied Psychology, 2011
- Structural equation modelling: Adjudging model fitPersonality and Individual Differences, 2007
- The Attack of the PsychometriciansPsychometrika, 2006
- Tucker's Congruence Coefficient as a Meaningful Index of Factor SimilarityMethodology, 2006
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Alternative Ways of Assessing Model FitSociological Methods & Research, 1992
- An index of goodness-of-fit based on noncentralityJournal of Classification, 1989
- Structural equation modeling in practice: A review and recommended two-step approach.Psychological Bulletin, 1988
- On Cross-Cultural Comparative Studies with the Eysenck Personality QuestionnaireJournal of Cross-Cultural Psychology, 1986
- Factor comparison: An examination of three methodsPersonality and Individual Differences, 1986