A Multilevel CFA-MTMM Model for Nested Structurally Different Methods
- 1 October 2015
- journal article
- research article
- Published by American Educational Research Association (AERA) in Journal of Educational and Behavioral Statistics
- Vol. 40 (5) , 477-510
Abstract
The numerous advantages of structural equation modeling (SEM) for the analysis of multitrait–multimethod (MTMM) data are well known. MTMM-SEMs allow researchers to explicitly model the measurement error, to examine the true convergent and discriminant validity of the given measures, and to relate external variables to the latent trait as well as the latent method factors in the model. According to Eid et al. (2008) different MTMM measurement designs require different types of MTMM-SEMs. Eid et al. (2008) proposed three different MTMM-SEMs for measurement designs with (a) structurally different methods, (b) interchangeable methods, and (c) a combination of both types of methods. In the present work, we extend this taxonomy to a multilevel correlated traits–correlated methods minus one [CTC(M − 1)] model for nested structurally different methods. The new model enables researchers to study method effects on both measurement levels (i.e., within and between clusters, classes, schools, etc.) and evaluate the convergent and discriminant validity of the measures. The statistical performance of the model is examined by a simulation study, and recommendations for the application of the model are given.Keywords
This publication has 41 references indexed in Scilit:
- Is there really a single factor of personality? A multirater approach to the apex of personalityJournal of Research in Personality, 2011
- Validating a Self-Report Screen for ADHD in Early Adulthood Using Childhood Parent and Teacher RatingsJournal of Attention Disorders, 2011
- Analyzing multitrait-mulitmethod data with multilevel confirmatory factor analysis: An application to the validation of the State-Trait Cheerfulness InventoryJournal of Research in Personality, 2011
- Correlation between patient and clinician assessments of depression severity in the PREVENT studyPsychiatry Research, 2010
- Analyzing the convergent and discriminant validity of states and traits: Development and applications of multimethod latent state-trait models.Psychological Assessment, 2008
- Structural equation modeling of multitrait-multimethod data: Different models for different types of methods.Psychological Methods, 2008
- Separating trait effects from trait-specific method effects in multitrait-multimethod models: A multiple-indicator CT-C(M-1) model.Psychological Methods, 2003
- A Multitrait-Multimethod Model with Minimal AssumptionsPsychometrika, 2000
- Multitrait-multimethod Analysis2000
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959