Suzanne Jak
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Suzanne Jak has a total of 37 co-authors. Here are the top co-authors by number of shared publications:
- Mike W. -L. Cheung
Department of Psychology, National University of Singapore, Singapore, Singapore
12 shared publications - Terrence D. Jorgensen
Research Institute of Child Development and Education, University of Amsterdam
4 shared publications - Frans Jeroen Oort
Research Institute of Child Development and Education, Faculty of Social and Behavioral Sciences, University of Amsterdam, Amsterdam, the Netherlands
3 shared publications Louise Elffers
Educational Sciences, Child Development and Education, University of Amsterdam, Amsterdam, The Netherlands
3 shared publications- Daury Jansen
Research Institute of Child Development and Education, University of Amsterdam, Amsterdam, The Netherlands
2 shared publications Frans J. Oort
Methods and Statistics, Research Institute of Child Development and Education, University of Amsterdam, Amsterdam, The Netherlands
2 shared publications
Latest Publications
- Open Access
- 14 October 2026
- Published by Wiley in British Journal of Mathematical and Statistical Psychology
- Vol. 79 (3) , 513-546
A taxonomy of reliability indices for cluster‐level constructs measured by multiple individual‐level indicators
Generalizability theory (GT) provides a variety of intraclass correlation coefficients (ICCs) to quantify reliability across different conditions of measurement—for example, scale and interrater reliability quantify generalization across items and raters, respectively. In a multilevel modelling (MLM) context, an ICC is often used to quantify the proportion of a subject‐level variable's variance that is attributable to cluster‐level differences (e.g., between schools or neighbourhoods). When data from cluster members are their ratings of a group‐level characteristic, the ICC is an inter‐rater reliability coefficient, interpreted as the degree to which observations of a cluster generalize across members of that cluster. Structural equation modelling (SEM) is becoming a popular framework for modelling GT, and the ‘omega’ indices of composite reliability—which are functions of SEM parameters—are special cases of GT (i.e., how measurements of a construct generalize across indicators). The merger of MLM and SEM (i.e., ML‐SEM) provides a unique opportunity to explore how well measurements of cluster‐level constructs generalize across multiple measurement conditions (indicators, cluster members, or both). A taxonomy of ICCs is explicated to appropriately quantify reliability across aspects of a procedure for measuring cluster‐level constructs, adding value to the limited ICCs currently considered in ML‐SEM applications.
- 14 October 2026
- Published by Wiley in British Journal of Mathematical and Statistical Psychology
- Vol. 79 (3) , 513-546
Open AccessA taxonomy of reliability indices for cluster‐level constructs measured by multiple individual‐level indicators
Generalizability theory (GT) provides a variety of intraclass correlation coefficients (ICCs) to quantify reliability across different conditions of measurement—for example, scale and interrater reliability quantify generalization across items and raters, respectively. In a multilevel modelling (MLM) context, an ICC is often used to quantify the proportion of a subject‐level variable's variance that is attributable to cluster‐level differences (e.g., between schools or neighbourhoods). When data from cluster members are their ratings of a group‐level characteristic, the ICC is an inter‐rater reliability coefficient, interpreted as the degree to which observations of a cluster generalize across members of that cluster. Structural equation modelling (SEM) is becoming a popular framework for modelling GT, and the ‘omega’ indices of composite reliability—which are functions of SEM parameters—are special cases of GT (i.e., how measurements of a construct generalize across indicators). The merger of MLM and SEM (i.e., ML‐SEM) provides a unique opportunity to explore how well measurements of cluster‐level constructs generalize across multiple measurement conditions (indicators, cluster members, or both). A taxonomy of ICCs is explicated to appropriately quantify reliability across aspects of a procedure for measuring cluster‐level constructs, adding value to the limited ICCs currently considered in ML‐SEM applications.
- Open Access
- 7 May 2026
- Published by Center for Open Science in PsyArXiv
Fitting two-level structural equation models to summary statistics: Leveling up meta-analytic structural equation modeling
Standard two-level SEM models require access to raw data. In this study we propose a method for fitting two-level SEMs using meta-analytic structural equation modelling (MASEM) on sum-mary statistics. Although our focus is on the meta-analytic case of individuals nested in studies, the approach could be applied to any two-level structure. An illustration using PISA data showed that fitting a two-level model on individual data versus fitting a two-level model using summary statistics produces essentially identical results. One advantage of the MASEM approach is that it is straightforward to model heterogeneity in the within-cluster covariances. Using simulated da-ta, we demonstrated that the MASEM method performed well in such heterogeneous conditions. In contrast, two-level SEM analyses resulted in inflated Type I errors based on the test statistic and a significant underestimation of the parameters' standard errors. Through an empirical ex-ample, we show how two-level SEM through the MASEM method can be employed to evaluate measurement invariance across all studies and how the model can be expanded to incorporate study-level variables that explain some of the variation in parameters across studies. Implications and limitations of the proposed method are discussed, and directions for future research are pro-vided.
- 7 May 2026
- Published by Center for Open Science in PsyArXiv
Open AccessFitting two-level structural equation models to summary statistics: Leveling up meta-analytic structural equation modeling
Standard two-level SEM models require access to raw data. In this study we propose a method for fitting two-level SEMs using meta-analytic structural equation modelling (MASEM) on sum-mary statistics. Although our focus is on the meta-analytic case of individuals nested in studies, the approach could be applied to any two-level structure. An illustration using PISA data showed that fitting a two-level model on individual data versus fitting a two-level model using summary statistics produces essentially identical results. One advantage of the MASEM approach is that it is straightforward to model heterogeneity in the within-cluster covariances. Using simulated da-ta, we demonstrated that the MASEM method performed well in such heterogeneous conditions. In contrast, two-level SEM analyses resulted in inflated Type I errors based on the test statistic and a significant underestimation of the parameters' standard errors. Through an empirical ex-ample, we show how two-level SEM through the MASEM method can be employed to evaluate measurement invariance across all studies and how the model can be expanded to incorporate study-level variables that explain some of the variation in parameters across studies. Implications and limitations of the proposed method are discussed, and directions for future research are pro-vided.
- Open Access
- 19 December 2025
- Published by Cambridge University Press (CUP) in Research Synthesis Methods
- Vol. 17 (3) , 498-516
Evaluating differences in latent means across studies: Extending meta-analytic confirmatory factor analysis with the analysis of means
Meta-analytic confirmatory factor analysis (CFA) is a type of meta-analytic structural equation modeling (MASEM) that is useful for evaluating the factor structure of measurement scales based on data from multiple studies. Modeling the factor structure is just one example of the many potentially interesting research questions. Analyzing covariance matrices allows for the evaluation of measurement properties across studies, such as whether indicators are functioning the same across studies. For example, are some indicators more indicative of the common factor in certain types of studies than in others? The additional analysis of means of the observed variables opens up many other research questions to consider such as: “Are there mean differences in mental health between clinical and non-clinical samples?” To answer such questions, it is necessary to analyze both the covariance and the mean structure of the indicators. In this paper, we present, illustrate, and evaluate a method to incorporate the means of variables in the MASEM analyses of such datasets. We focus on meta-analytic CFA, with the aim of testing differences in latent means across studies. We provide illustrations of the comparison of latent means across groups of studies using two empirical datasets, for which data and analysis scripts are provided online. The performance of the new model was tested in a small-scale simulation study. The results showed adequate performance under the tested conditions. Finally, we discuss how the proposed method relates to other analysis options such as multigroup or multilevel structural equation modeling.
- 19 December 2025
- Published by Cambridge University Press (CUP) in Research Synthesis Methods
- Vol. 17 (3) , 498-516
Open AccessEvaluating differences in latent means across studies: Extending meta-analytic confirmatory factor analysis with the analysis of means
Meta-analytic confirmatory factor analysis (CFA) is a type of meta-analytic structural equation modeling (MASEM) that is useful for evaluating the factor structure of measurement scales based on data from multiple studies. Modeling the factor structure is just one example of the many potentially interesting research questions. Analyzing covariance matrices allows for the evaluation of measurement properties across studies, such as whether indicators are functioning the same across studies. For example, are some indicators more indicative of the common factor in certain types of studies than in others? The additional analysis of means of the observed variables opens up many other research questions to consider such as: “Are there mean differences in mental health between clinical and non-clinical samples?” To answer such questions, it is necessary to analyze both the covariance and the mean structure of the indicators. In this paper, we present, illustrate, and evaluate a method to incorporate the means of variables in the MASEM analyses of such datasets. We focus on meta-analytic CFA, with the aim of testing differences in latent means across studies. We provide illustrations of the comparison of latent means across groups of studies using two empirical datasets, for which data and analysis scripts are provided online. The performance of the new model was tested in a small-scale simulation study. The results showed adequate performance under the tested conditions. Finally, we discuss how the proposed method relates to other analysis options such as multigroup or multilevel structural equation modeling.
- Open Access
- 11 September 2025
- Published by Center for Open Science in PsyArXiv
Evaluating differences in latent means across studies: Extending meta-analytic confirmatory factor analysis with the analysis of means
Meta-analytic confirmatory factor analysis (CFA) is a type of meta-analytic structural equation modeling (MASEM) that is useful for evaluating the factor structure of measurement scales based on data from multiple studies. Modeling the factor structure is just one example of many potentially interesting research questions. Analyzing covariance matrices allows for the evaluation of measurement properties across studies, such as whether indicators are functioning the same across studies. For example, are some indicators more indicative of the common factor in certain types of studies than in others? The additional analysis of means of the observed variables opens up many other research questions to consider such as: ‘Are there mean differences in mental health between clinical and non-clinical samples?’. To answer such questions, it is necessary to analyze both the covariance and the mean structure of the indicators. Meta-analytic CFA with means is applicable when the studies included in the meta-analysis used the same indicators, measured on the same scales. In this paper, we present and illustrate a method to incorporate the means of variables in MASEM analyses of such datasets. We focus on meta-analytic CFA, with the aim of testing differences in latent means across studies. We provide illustrations of the comparison of latent means across groups of studies using two empirical datasets, for which data and analysis scripts are provided online. Finally, we discuss how the proposed method relates to other analysis options such as multigroup or multilevel structural equation modeling.
- 11 September 2025
- Published by Center for Open Science in PsyArXiv
Open AccessEvaluating differences in latent means across studies: Extending meta-analytic confirmatory factor analysis with the analysis of means
Meta-analytic confirmatory factor analysis (CFA) is a type of meta-analytic structural equation modeling (MASEM) that is useful for evaluating the factor structure of measurement scales based on data from multiple studies. Modeling the factor structure is just one example of many potentially interesting research questions. Analyzing covariance matrices allows for the evaluation of measurement properties across studies, such as whether indicators are functioning the same across studies. For example, are some indicators more indicative of the common factor in certain types of studies than in others? The additional analysis of means of the observed variables opens up many other research questions to consider such as: ‘Are there mean differences in mental health between clinical and non-clinical samples?’. To answer such questions, it is necessary to analyze both the covariance and the mean structure of the indicators. Meta-analytic CFA with means is applicable when the studies included in the meta-analysis used the same indicators, measured on the same scales. In this paper, we present and illustrate a method to incorporate the means of variables in MASEM analyses of such datasets. We focus on meta-analytic CFA, with the aim of testing differences in latent means across studies. We provide illustrations of the comparison of latent means across groups of studies using two empirical datasets, for which data and analysis scripts are provided online. Finally, we discuss how the proposed method relates to other analysis options such as multigroup or multilevel structural equation modeling.
- Open Access
- 18 June 2025
- Published by Taylor & Francis in Structural Equation Modeling: A Multidisciplinary Journal
- Vol. 32 (5) , 801-813
Does Cluster-Robust Estimation Provide Within-Study Effects? A Comparison of Individual Participant Data Methods in MASEM
Researchers conducting meta-analytical structural equation modeling (MASEM) with individual participant data can choose from several methods, including cluster-robust estimation, two-level SEM, multivariate meta-analysis of path coefficients, and One-Stage MASEM (OSMASEM). While two-level SEM and OSMASEM model within- and between-study effects separately, cluster-robust estimation combines them, estimating an overall path coefficient. Despite its popularity, cluster-robust estimation often yields results that differ from other methods. Simulations using factor models and real-world comparisons using path models show that it may not accurately reflect within-study estimates and can produce biased standard errors. This study compares IPD MASEM methods using simulated data, varying intraclass correlations, parameter equality across levels, number of studies, and missing data. Results reveal that cluster-robust estimation frequently misrepresents within-study estimates, produces biased standard errors, and tends to incorrectly reject model fit, highlighting the need for careful method selection in IPD MASEM applications.
- 18 June 2025
- Published by Taylor & Francis in Structural Equation Modeling: A Multidisciplinary Journal
- Vol. 32 (5) , 801-813
Open AccessDoes Cluster-Robust Estimation Provide Within-Study Effects? A Comparison of Individual Participant Data Methods in MASEM
Researchers conducting meta-analytical structural equation modeling (MASEM) with individual participant data can choose from several methods, including cluster-robust estimation, two-level SEM, multivariate meta-analysis of path coefficients, and One-Stage MASEM (OSMASEM). While two-level SEM and OSMASEM model within- and between-study effects separately, cluster-robust estimation combines them, estimating an overall path coefficient. Despite its popularity, cluster-robust estimation often yields results that differ from other methods. Simulations using factor models and real-world comparisons using path models show that it may not accurately reflect within-study estimates and can produce biased standard errors. This study compares IPD MASEM methods using simulated data, varying intraclass correlations, parameter equality across levels, number of studies, and missing data. Results reveal that cluster-robust estimation frequently misrepresents within-study estimates, produces biased standard errors, and tends to incorrectly reject model fit, highlighting the need for careful method selection in IPD MASEM applications.
- Open Access
- 30 May 2025
- Published by SAGE Publications in Assessment
- Vol. 33 (4) , 510-532
Evaluating the ICD-11 PTSD and Complex PTSD Constructs: A Meta-Analytic Confirmatory Factor Analysis of the International Trauma Questionnaire
The International Trauma Questionnaire (ITQ) is a widely used diagnostic tool for post-traumatic stress disorder (PTSD) and complex PTSD (CPTSD). Although findings are mixed, investigations of the ITQ’s internal structure have most often supported a six-factor first-order model and a two-factor second-order model. This study utilized meta-analytic factor analysis to investigate the ITQ’s latent structure. A systematic search of PsycINFO, Web of Science, PubMed, MEDLINE, Cochrane, Scopus, CINAHL, and ProQuest Dissertations was conducted, with 57 studies (total N = 43,066) included in the final analysis. A two-stage meta-analytic structural equation modeling approach was implemented which pooled correlation matrices and performed confirmatory factor analyses. The two-factor second-order model demonstrated good fit, emphasizing its clinical relevance. However, a seven-factor correlated first-order model demonstrated superior fit, consistently outperforming other models across ITQ versions, symptom severity levels, English versus translated versions, and both PTSD and non-PTSD samples. This model indicates that CPTSD encompasses a broad range of symptoms and specifically that the distinction between affective hyperactivation and hypoactivation is important to progress the construct validity of CPTSD. Additionally, reliability analyses revealed limited internal consistency at the subscale level. These findings highlight the need for comprehensive assessments and refined item content to enhance CPTSD measurement.
- 30 May 2025
- Published by SAGE Publications in Assessment
- Vol. 33 (4) , 510-532
Open AccessEvaluating the ICD-11 PTSD and Complex PTSD Constructs: A Meta-Analytic Confirmatory Factor Analysis of the International Trauma Questionnaire
The International Trauma Questionnaire (ITQ) is a widely used diagnostic tool for post-traumatic stress disorder (PTSD) and complex PTSD (CPTSD). Although findings are mixed, investigations of the ITQ’s internal structure have most often supported a six-factor first-order model and a two-factor second-order model. This study utilized meta-analytic factor analysis to investigate the ITQ’s latent structure. A systematic search of PsycINFO, Web of Science, PubMed, MEDLINE, Cochrane, Scopus, CINAHL, and ProQuest Dissertations was conducted, with 57 studies (total N = 43,066) included in the final analysis. A two-stage meta-analytic structural equation modeling approach was implemented which pooled correlation matrices and performed confirmatory factor analyses. The two-factor second-order model demonstrated good fit, emphasizing its clinical relevance. However, a seven-factor correlated first-order model demonstrated superior fit, consistently outperforming other models across ITQ versions, symptom severity levels, English versus translated versions, and both PTSD and non-PTSD samples. This model indicates that CPTSD encompasses a broad range of symptoms and specifically that the distinction between affective hyperactivation and hypoactivation is important to progress the construct validity of CPTSD. Additionally, reliability analyses revealed limited internal consistency at the subscale level. These findings highlight the need for comprehensive assessments and refined item content to enhance CPTSD measurement.
- Open Access
- 9 January 2025
- Published by Springer Nature in Behavior Research Methods
- Vol. 57 (1) , 1-2
Author Correction: Analytical power calculations for structural equation modeling: A tutorial and Shiny app
- 9 January 2025
- Published by Springer Nature in Behavior Research Methods
- Vol. 57 (1) , 1-2
Open AccessAuthor Correction: Analytical power calculations for structural equation modeling: A tutorial and Shiny app
- Open Access
- 1 January 2025
- Published by Cambridge University Press (CUP) in Research Synthesis Methods
- Vol. 16 (1) , 60-86
Six ways to handle dependent effect sizes in meta-analytic structural equation modeling: Is there a gold standard?
The current meta-analytic structural equation modeling (MASEM) techniques cannot properly deal with cases where there are multiple effect sizes available for the same relationship from the same study. Existing applications either treat these effect sizes as independent, randomly select one effect size amongst many, or create an average effect size. None of these approaches deal with the inherent dependency in effect sizes, and either leads to biased estimates or loss of information and power. An alternative technique is to use univariate three-level modeling in the two-stage approach to model these dependencies. These different strategies for dealing with dependent effect sizes in the context of MASEM have not been previously compared in a simulation study. This study aims to compare the performance of these strategies across different conditions; varying the number of studies, the number of dependent effect sizes within studies, the correlation between the dependent effect sizes, the magnitude of the path coefficient, and the between-studies variance. We examine the relative bias in parameter estimates and standard errors, coverage proportions of confidence intervals, as well as mean standard error and power as measures of efficiency. The results suggest that there is not one method that performs well across all these criteria, pointing to the need for better methods.
- 1 January 2025
- Published by Cambridge University Press (CUP) in Research Synthesis Methods
- Vol. 16 (1) , 60-86
Open AccessSix ways to handle dependent effect sizes in meta-analytic structural equation modeling: Is there a gold standard?
The current meta-analytic structural equation modeling (MASEM) techniques cannot properly deal with cases where there are multiple effect sizes available for the same relationship from the same study. Existing applications either treat these effect sizes as independent, randomly select one effect size amongst many, or create an average effect size. None of these approaches deal with the inherent dependency in effect sizes, and either leads to biased estimates or loss of information and power. An alternative technique is to use univariate three-level modeling in the two-stage approach to model these dependencies. These different strategies for dealing with dependent effect sizes in the context of MASEM have not been previously compared in a simulation study. This study aims to compare the performance of these strategies across different conditions; varying the number of studies, the number of dependent effect sizes within studies, the correlation between the dependent effect sizes, the magnitude of the path coefficient, and the between-studies variance. We examine the relative bias in parameter estimates and standard errors, coverage proportions of confidence intervals, as well as mean standard error and power as measures of efficiency. The results suggest that there is not one method that performs well across all these criteria, pointing to the need for better methods.
- Open Access
- 17 October 2024
- Published by SAGE Publications in Advances in Methods and Practices in Psychological Science
- Vol. 7 (4)
A Cautionary Note on Using Univariate Methods for Meta-Analytic Structural Equation Modeling
Meta-analytic structural equation modeling (MASEM) is an increasingly popular technique in psychology, especially in management and organizational psychology. MASEM refers to fitting structural equation models (SEMs), such as path models or factor models, to meta-analytic data. The meta-analytic data, obtained from multiple primary studies, generally consist of correlations across the variables in the path or factor model. In this study, we contrast the method that is most often applied in management and organizational psychology (the univariate-r method) to several multivariate methods. “Univariate-r” refers to performing multiple univariate meta-analyses to obtain a synthesized correlation matrix as input in an SEM program. In multivariate MASEM, a multivariate meta-analysis is used to synthesize correlation matrices across studies (e.g., generalized least squares, two-stage SEM, one-stage MASEM). We conducted a systematic search on applications of MASEM in the field of management and organizational psychology and showed that reanalysis of the four available data sets using multivariate MASEM can lead to different conclusions than applying univariate-r. In two simulation studies, we show that the univariate-r method leads to biased standard errors of path coefficients and incorrect fit statistics, whereas the multivariate methods generally perform adequately. In the article, we also discuss some issues that possibly hinder researchers from applying multivariate methods in MASEM.
- 17 October 2024
- Published by SAGE Publications in Advances in Methods and Practices in Psychological Science
- Vol. 7 (4)
Open AccessA Cautionary Note on Using Univariate Methods for Meta-Analytic Structural Equation Modeling
Meta-analytic structural equation modeling (MASEM) is an increasingly popular technique in psychology, especially in management and organizational psychology. MASEM refers to fitting structural equation models (SEMs), such as path models or factor models, to meta-analytic data. The meta-analytic data, obtained from multiple primary studies, generally consist of correlations across the variables in the path or factor model. In this study, we contrast the method that is most often applied in management and organizational psychology (the univariate-r method) to several multivariate methods. “Univariate-r” refers to performing multiple univariate meta-analyses to obtain a synthesized correlation matrix as input in an SEM program. In multivariate MASEM, a multivariate meta-analysis is used to synthesize correlation matrices across studies (e.g., generalized least squares, two-stage SEM, one-stage MASEM). We conducted a systematic search on applications of MASEM in the field of management and organizational psychology and showed that reanalysis of the four available data sets using multivariate MASEM can lead to different conclusions than applying univariate-r. In two simulation studies, we show that the univariate-r method leads to biased standard errors of path coefficients and incorrect fit statistics, whereas the multivariate methods generally perform adequately. In the article, we also discuss some issues that possibly hinder researchers from applying multivariate methods in MASEM.