DIF for examinees with different academic backgrounds
Author:
- 1 January 2004
- journal article
- research article
- Published by SAGE Publications in Language Testing
- Vol. 21 (1) , 53-73
Abstract
The purpose of the present study was to investigate differential item function (DIF) on the English subtest of the 1998 Korean National Entrance Exam for Colleges and Universities for examinees with different academic backgrounds (i.e., Humanities vs. Sciences) using the Item Response Theory (IRT) Likelihood Ratio (LR) approach. The English subtest consisted of a total of 55 items, which comprised the subscales of Listening Comprehension and Reading Comprehension. Data were fitted with a modified three parameter logistic IRT model, and DIF was detected using both the Mantel-Haenszel procedure and the IRT likelihood ratio approach. To evaluate a baseline estimate of DIF due to chance, the entire DIF detection procedure was repeated, with the sample randomly divided in half. The results of the study identified 18 DIF items with 28 DIF parameters. DIF magnitude for each studied item is also provided. Results of a preliminary content analysis are discussed in terms of the relationships between DIF directions and item content. Implications and recommendations for future research are also addressed.Keywords
This publication has 23 references indexed in Scilit:
- Differential Item Functioning in the Wisc-III: Item Parameters for Boys and Girls in the National Standardization SampleEducational and Psychological Measurement, 2001
- Using Statistical Procedures to Identify Differentially Functioning Test ItemsEducational Measurement: Issues and Practice, 1998
- Item‐Bundle DIF Hypothesis Testing: Identifying Suspect Bundles and Assessing Their Differential FunctioningJournal of Educational Measurement, 1996
- A Multidimensionality-Based DIF Analysis ParadigmApplied Psychological Measurement, 1996
- The Effect of Language Background on “Foreign” Language Test Performance: The Case of Chinese, Italian, and Modern GreekLanguage Learning, 1996
- Accuracy of Bias Review Judges in Identifying Differential Item Functioning on Teacher Certification TestsApplied Measurement in Education, 1990
- Student major field and text content: interactive effects on reading comprehension in the Test of English as a Foreign LanguageLanguage Testing, 1988
- Study of the measurement bias of two standardized psychological tests.Journal of Applied Psychology, 1987
- Linguistic and cultural bias in language proficiency testsLanguage Testing, 1985
- A Comparison of a Statistical and Subjective Procedure to Ascertain Item Validity: One Step in the Test Validation ProcessEducational and Psychological Measurement, 1980