Testing measurement invariance of mathematics self-concept and self-efficacy in PISA using MGCFA and the alignment method
Open Access
- 8 June 2022
- journal article
- research article
- Published by Springer Nature in European Journal of Psychology of Education
- Vol. 38 (2) , 709-732
Abstract
The aim of the study is to investigate the measurement invariance of mathematics self-concept and self-efficacy across 40 countries that participated in the Programme for International Student Assessment (PISA) 2003 and 2012 cycles. The sample of the study consists of 271,760 students in PISA 2003 and 333,804 students in PISA 2012. Firstly, the traditional measurement invariance testing was applied in the multiple-group confirmatory factor analysis (MGCFA). Then, the alignment analyses were performed, allowing non-invariance to a minimum to estimate all of the parameters. Results from MGCFA indicate that mathematics self-concept and self-efficacy hold metric invariance across the 80 groups (cycle by country). The alignment method results suggest that a large proportion of non-invariance exists in both mathematics self-concept and self-efficacy factors, and the factor means cannot be compared across all participating countries. Results of the Monte Carlo simulation show that the alignment results are trustworthy. Implications and limitations are discussed, and some recommendations for future research are proposed.Keywords
Funding Information
- University of Gothenburg
This publication has 56 references indexed in Scilit:
- Self-concept and native language background: A study of measurement invariance and cross-group comparisons in third grade.Journal of Educational Psychology, 2013
- Using a Multilevel Structural Equation Modeling Approach to Explain Cross-Cultural Measurement NoninvarianceJournal of Cross-Cultural Psychology, 2012
- Academic self‐concept and academic achievement: Relations and causal orderingBritish Journal of Educational Psychology, 2011
- Impact of Measurement Invariance on Construct Correlations, Mean Differences, and Relations With External CorrelatesAssessment, 2010
- The Big-fish–little-pond-effect Stands Up to Critical Scrutiny: Implications for Theory, Methodology, and Future ResearchEducational Psychology Review, 2008
- Evaluating Goodness-of-Fit Indexes for Testing Measurement InvarianceStructural Equation Modeling: A Multidisciplinary Journal, 2002
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Self-Efficacy Beliefs in Academic SettingsReview of Educational Research, 1996
- Self-efficacy and achievement behaviorsEducational Psychology Review, 1989
- A New Incremental Fit Index for General Structural Equation ModelsSociological Methods & Research, 1989