Comparability of TOEFL CBT Writing Prompts for Different Native Language Groups
Authors:
- 1 June 2005
- journal article
- research article
- Published by Taylor & Francis in International Journal of Testing
- Vol. 5 (2) , 131-158
Abstract
This study has investigated the comparability of computer-based testing writing prompts in the Test of English as a Foreign LanguageTM (TOEFL) for examinees of different native language backgrounds. A total of 81 writing prompts introduced from July 1998 through August 2000 were examined using a 3-step logistic regression procedure for ordinal items. An English language ability (ELA) variable was created by summing the standardized TOEFL Reading, Listening, and Structure scale scores. This ELA variable was used to match examinees of East Asian (Chinese, Japanese, and Korean) and European (German, French, and Spanish) language groups. Although about one third of the 81 prompts were initially flagged because of statistically significant group effects; the effect sizes were too small for any of those flagged prompts to be classified as having an important group effect.Keywords
This publication has 34 references indexed in Scilit:
- New Directions in Contrastive RhetoricTESOL Quarterly, 2002
- Second Language Writers' Text2002
- Evaluating Type I Error and Power Rates Using an Effect Size Measure With the Logistic Regression Procedure for DIF DetectionApplied Measurement in Education, 2001
- Detecting DIF across the different language groups in a speaking testLanguage Testing, 2001
- Using G-theory and Many-facet Rasch measurement in the development of performance assessments of the ESL speaking skills of immigrantsLanguage Testing, 1998
- Using Statistical Procedures to Identify Differentially Functioning Test ItemsEducational Measurement: Issues and Practice, 1998
- Indirectness in L1 and L2 academic writingJournal of Pragmatics, 1997
- Logistic Regression and Its Use in Detecting Differential Item Functioning in Polytomous ItemsJournal of Educational Measurement, 1996
- Accounting for nonsystematic error in performance ratingsLanguage Testing, 1996
- Linguistic and cultural bias in language proficiency testsLanguage Testing, 1985