A Comparison of Item-Level and Scale-Level Multiple Imputation for Questionnaire Batteries
Authors:
- 8 February 2012
- journal article
- research article
- Published by Taylor & Francis in Multivariate Behavioral Research
- Vol. 47 (1) , 1-25
Abstract
Behavioral science researchers routinely use scale scores that sum or average a set of questionnaire items to address their substantive questions. A researcher applying multiple imputation to incomplete questionnaire data can either impute the incomplete items prior to computing scale scores or impute the scale scores directly from other scale scores. This study used a Monte Carlo simulation to assess the impact of imputation method on the bias and efficiency of scale-level parameter estimates, including scale score means, between-scale correlations, and regression coefficients. Although the choice of imputation approach had no influence on the bias of scale-level parameter estimates, it had a substantial impact on efficiency, such that item-level imputation consistently produced a meaningful power advantage. The simulation results clearly supported the use of item-level imputation. To illustrate the differences between item- and scale-level imputation, we examined predictors of 7th-grade academic self-efficacy in a sample of 595 low-income Mexican Origin adolescents in a planned missingness design. The results of the empirical data analysis were consistent with those of the simulation and also suggested that researchers should be cautious when implementing planned missing data designs that necessitate scale-level imputation.Keywords
This publication has 29 references indexed in Scilit:
- Engaging Mexican Origin Families in a School-Based Preventive InterventionJournal of Prevention, 2007
- How Many Imputations are Really Needed? Some Practical Clarifications of Multiple Imputation TheoryPrevention Science, 2007
- Using the Expectation Maximization Algorithm to Estimate Coefficient Alpha for Scales With Item-Level Missing Data.Psychological Methods, 2003
- Imputation of missing values in the case of a multiple item instrument measuring alcohol consumptionStatistics in Medicine, 2001
- Influence of Imputation and EM Methods on Factor Analysis when Item Nonresponse in Questionnaire Data is NonignorableMultivariate Behavioral Research, 2000
- Factor Analysis of Multidimensional Polytomous Item Response Data Suffering From Ignorable Item NonresponseMultivariate Behavioral Research, 1999
- Missing Data in Likert Ratings: A Comparison of Replacement MethodsThe Journal of General Psychology, 1998
- Meta-analysis of experiments with matched groups or repeated measures designs.Psychological Methods, 1996
- Maximizing the Usefulness of Data Obtained with Planned Missing Value Patterns: An Application of Maximum Likelihood ProceduresMultivariate Behavioral Research, 1996
- Development and Validation of an Early Adolescent Temperament MeasureThe Journal of Early Adolescence, 1992