Incremental Model Fit Assessment in the Case of Categorical Data: Tucker–Lewis Index for Item Response Theory Modeling
Authors:
Open Access
- 10 May 2021
- journal article
- research article
- Published by Springer Nature in Prevention Science
- Vol. 24 (3) , 455-466
Abstract
The Tucker–Lewis index (TLI; Tucker & Lewis, 1973), also known as the non-normed fit index (NNFI; Bentler & Bonett, 1980), is one of the numerous incremental fit indices widely used in linear mean and covariance structure modeling, particularly in exploratory factor analysis, tools popular in prevention research. It augments information provided by other indices such as the root-mean-square error of approximation (RMSEA). In this paper, we develop and examine an analogous index for categorical item level data modeled with item response theory (IRT). The proposed Tucker–Lewis index for IRT (TLIRT) is based on Maydeu-Olivares and Joe's (2005) $$M_2$$ family of limited-information overall model fit statistics. The limited-information fit statistics have significantly better Chi-square approximation and power than traditional full-information Pearson or likelihood ratio statistics under realistic situations. Building on the incremental fit assessment principle, the TLIRT compares the fit of model under consideration along a spectrum of worst to best possible model fit scenarios. We examine the performance of the new index using simulated and empirical data. Results from a simulation study suggest that the new index behaves as theoretically expected, and it can offer additional insights about model fit not available from other sources. In addition, a more stringent cutoff value is perhaps needed than Hu and Bentler's (1999) traditional cutoff criterion with continuous variables. In the empirical data analysis, we use a data set from a measurement development project in support of cigarette smoking cessation research to illustrate the usefulness of the TLIRT. We noticed that had we only utilized the RMSEA index, we could have arrived at qualitatively different conclusions about model fit, depending on the choice of test statistics, an issue to which the TLIRT is relatively more immune.
Keywords
This publication has 37 references indexed in Scilit:
- Item factor analysis: Current approaches and future directions.Psychological Methods, 2007
- Limited‐information goodness‐of‐fit testing of item response theory models for sparse 2
P
tablesBritish Journal of Mathematical and Statistical Psychology, 2006
- Limited- and Full-Information Estimation and Goodness-of-Fit Testing in 2nContingency TablesJournal of the American Statistical Association, 2005
- The Goodness of Fit of Latent Trait Models in Attitude MeasurementSociological Methods & Research, 1999
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Alternative Ways of Assessing Model FitSociological Methods & Research, 1992
- Representing sources of error in the common-factor model: Implications for theory and practice.Psychological Bulletin, 1991
- Model selection in covariance structures analysis and the "problem" of sample size: A clarification.Psychological Bulletin, 1991
- Significance tests and goodness of fit in the analysis of covariance structures.Psychological Bulletin, 1980
- Some Problems of Statistics and Everyday LifeJournal of the American Statistical Association, 1979