8. A New Approach to Evaluating the Quality of Measurement Instruments: The Split-Ballot MTMM Design
- 1 December 2004
- journal article
- Published by SAGE Publications in Sociological Methodology
- Vol. 34 (1) , 311-347
Abstract
Two distinctly different quantitative approaches are used to evaluate measurement instruments: the split-ballot experiment and the multitrait-multimethod (MTMM) approach. The first approach is typically used to indicate whether variation in the method causes differences in the response distribution; the second approach evaluates the reliability and validity of different methods. The new approach, suggested in this paper, combines the more attractive features of both methods. The strength of the split-ballot experiment is its use of independent random samples from the same population to provide information about differences in response distributions. This is also possible with the new approach, but this approach provides more detailed information about the reasonsKeywords
This publication has 30 references indexed in Scilit:
- Fit of Different Models for Multitrait-Multimethod ExperimentsStructural Equation Modeling: A Multidisciplinary Journal, 2002
- Alternative approaches to structural modeling of ordinal data: A Monte Carlo studyStructural Equation Modeling: A Multidisciplinary Journal, 1997
- Multitrait-Multimethod Matrices in Consumer ResearchJournal of Consumer Research, 1991
- Confirmatory Factor Analyses of Multitrait-Multimethod Data: A Comparison of Alternative ModelsApplied Psychological Measurement, 1991
- Estimation Problems in the Block-Diagonal Model of the Multitrait-Multimethod MatrixApplied Psychological Measurement, 1990
- Pseudo-Maximum Likelihood Estimation of Mean and Covariance Structures with Missing DataJournal of the American Statistical Association, 1990
- Msultiplicative Models and MTMM MatricesJournal of Educational Statistics, 1988
- Estimation of Linear Models with Incomplete DataSociological Methodology, 1987
- Path analysis: Psychological examples.Psychological Bulletin, 1970
- Convergent and discriminant validation by the multitrait-multimethod matrix.Psychological Bulletin, 1959