Goodness‐of‐fit testing in sparse contingency tables when the number of variables is large
Author:
- 9 June 2019
- journal article
- review article
- Published by Wiley in WIREs Computational Statistics
- Vol. 11 (6)
Abstract
The Pearson and likelihood ratio statistics are commonly used to test goodness of fit for models applied to data from a multinomial distribution. When data are from a table formed by the cross‐classification of a large number of variables, the common statistics may have low power and inaccurate Type I error level due to sparseness. One approach to finding a valid approximation to the achieved significance level (ASL) is to use a bootstrap distribution for the test statistic. For a composite null hypothesis with unknown parameters, the parametric bootstrap has been employed. The parametric bootstrap can be computationally demanding, but a recent development provides a method for computationally efficient calculation of the Pearson–Fisher statistic for very large sparse tables. Another approach employs orthogonal components of the Pearson–Fisher statistic obtained from lower‐order marginal distributions of a large cross‐classified table rather than the joint distribution. These statistics are used essentially for focused tests and have mostly been applied to latent variable models. They have very good performance for Type I error rate and power, even when applied to a sparse table. However, there are limitations when the number of variables becomes larger than 20. Some related statistics also employ lower‐order marginals, but they are not components of the Pearson–Fisher statistic. The performance of these approaches is compared for obtaining a valid ASL for a goodness‐of‐fit test applied to a very large multi‐way contingency table. The approaches are compared with a small simulation study.This article is categorized under: Types and Structure > Categorical Data Statistical and Graphical Methods of Data Analysis > Bootstrap and Resampling Statistical Models > Fitting ModelsKeywords
This publication has 38 references indexed in Scilit:
- Goodness‐of‐fit testing using components based on marginal frequencies of multinomial dataBritish Journal of Mathematical and Statistical Psychology, 2008
- Limited‐information goodness‐of‐fit testing of item response theory models for sparse 2
P
tablesBritish Journal of Mathematical and Statistical Psychology, 2006
- Limited- and Full-Information Estimation and Goodness-of-Fit Testing in 2nContingency TablesJournal of the American Statistical Association, 2005
- Type I errors and power of the parametric bootstrap goodness‐of‐fit test: Full and limited informationBritish Journal of Mathematical and Statistical Psychology, 2003
- Testing Goodness of Fit with Multinomial DataJournal of the American Statistical Association, 1997
- Jackknifing and Bootstrapping Goodness-of-Fit Statistics in Sparse MultinomialsJournal of the American Statistical Association, 1986
- Goodness-of-Fit Tests for Log-Linear Models in Sparse Contingency TablesJournal of the American Statistical Association, 1986
- An Empirical Investigation of Goodness-of-Fit Statistics for Sparse MultinomialsJournal of the American Statistical Association, 1980
- Inaccuracy of the X 2 Test of Goodness of Fit when Expected Frequenies are SmallJournal of the American Statistical Association, 1973
- The Analysis of Residuals in Cross-Classified Tables1973