A comparison of three sets of criteria for determining the presence of differential item functioning using ordinal logistic regression
- 7 June 2007
- journal article
- Published by Springer Nature in Quality of Life Research
- Vol. 16 (S1) , 69-84
Abstract
Several techniques have been developed to detect differential item functioning (DIF), including ordinal logistic regression (OLR). This study compared different criteria for determining whether items have DIF using OLR. To compare and contrast findings from three different sets of criteria for detecting DIF using OLR. General distress and physical functioning items were evaluated for DIF related to five covariates: age, marital status, gender, race, and Hispanic origin. Cross-sectional study. 1,714 patients with cancer or HIV/AIDS. A total of 23 items addressing physical functioning and 15 items addressing general distress were selected from a pool of 154 items from four different health-related quality of life questionnaires. The three sets of criteria produced qualitatively and quantitatively different results. Criteria based on statistical significance alone detected DIF in almost all the items, while alternative criteria based on magnitude detected DIF in far fewer items. Accounting for DIF by using demographic-group specific item parameters had negligible effects on individual scores, except for race. Specific criteria chosen to determine whether items have DIF have an impact on the findings. Criteria based entirely on statistical significance may detect small differences that are clinically negligible.Keywords
This publication has 28 references indexed in Scilit:
- Cross-Cultural Evaluation of Health Status Using Item Response TheoryEvaluation & the Health Professions, 2005
- Test bias in a cognitive test: differential item functioning in the CASIStatistics in Medicine, 2004
- Is the Rivermead Mobility Index appropriate to measure mobility in lower limb amputees?Disability and Rehabilitation, 2003
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification.Psychological Methods, 1998
- The rand 36‐item health survey 1.0Health Economics, 1993
- The European Organization for Research and Treatment of Cancer QLQ-C30: A Quality-of-Life Instrument for Use in International Clinical Trials in OncologyJNCI: Journal of the National Cancer Institute, 1993
- The MOS 36-Item Short-Form Health Survey (SF-36)Medical Care, 1993
- The MOS 36-ltem Short-Form Health Survey (SF-36)Medical Care, 1992
- Detecting Differential Item Functioning Using Logistic Regression ProceduresJournal of Educational Measurement, 1990