Performance of DIMTEST- and NOHARM-Based Statistics for Testing Unidimensionality
Authors:
- 1 July 2007
- journal article
- Published by SAGE Publications in Applied Psychological Measurement
- Vol. 31 (4) , 292-307
Abstract
This Monte Carlo study compares the ability of the parametric bootstrap version of DIMTEST with three goodness-of-fit tests calculated from a fitted NOHARM model to detect violations of the assumption of unidimensionality in testing data. The effectiveness of the procedures was evaluated for different numbers of items, numbers of examinees, correlations between underlying ability dimensions, skewness of underlying ability distributions, and the presence or absence of a guessing parameter. In the absence of guessing, DIMTEST and the NOHARM-based statistics had similar power, with the χ 2 statistic having a very low Type I error rate. In the presence of guessing, however, two of the NOHARM-based statistics had unacceptably high Type I error rates, while the third performed similarly to DIMTEST. Given this inflated error rate, the study compares the empirical powers after adjusting for the discrepancy in Type I error rates.Keywords
This publication has 27 references indexed in Scilit:
- Limited Information Estimation and Testing of Thurstonian Models for Paired Comparison Data Under Multiple Judgment SamplingPsychometrika, 2001
- Simulating Correlated Multivariate Nonnormal Distributions: Extending the Fleishman Power MethodPsychometrika, 1999
- Local Dependence Indexes for Item Pairs Using Item Response TheoryJournal of Educational and Behavioral Statistics, 1997
- Monte Carlo Studies in Item Response TheoryApplied Psychological Measurement, 1996
- Using an Approximate Chi‐Square Statistic to Test the Number of Dimensions Underlying the Responses to a Set of ItemsJournal of Educational Measurement, 1996
- An Assessment of Stout's Index of Essential UnidimensionalityApplied Psychological Measurement, 1996
- Thin versus Thick Matching in the Mantel-Haenszel Procedure for Detecting DIFJournal of Educational Statistics, 1993
- NOHARM: Least Squares Item Factor AnalysisMultivariate Behavioral Research, 1988
- An Examination of the Characteristics of Unidimensional IRT Parameter Estimates Derived From Two-Dimensional DataApplied Psychological Measurement, 1985
- An Analysis of the Verbal Scholastic Aptitude Test Using Birnbaum's Three-Parameter Logistic ModelEducational and Psychological Measurement, 1968