Re-fitting for a different purpose: A case study of item writer practices in adapting source texts for a test of academic reading
Authors:
- 24 October 2011
- journal article
- Published by SAGE Publications in Language Testing
- Vol. 29 (1) , 109-129
Abstract
The important yet under-researched role of item writers in the selection and adaptation of texts for high-stakes reading tests is investigated through a case study involving a group of trained item writers working on the International English Language Testing System (IELTS). In the first phase of the study, participants were invited to reflect in writing, and then audio-recorded in a semantic-differential-based joint discussion, on the processes they employed to generate test material. The group were next observed at a simulated item writers’ editing meeting to refine their texts and items for an IELTS reading test module. The participants’ written descriptions and recorded discussions provided rich data on how source texts were perceived, selected and adapted for the Test. The study reports findings from textual analyses using indices of readability and lexical density from the original material sourced by the item writers and their adapted versions for the test. Results from qualitative and quantitive analyses are discussed in terms of the implications for the IELTS reading module of editing actions such as: reducing redundancy and technical language, changing styles, deciding on potentially sensitive issues and relationships between texts and test items. The important issue of text authenticity in tests such as IELTS is also broached.Keywords
This publication has 9 references indexed in Scilit:
- GENERATING AUTOMATED TEXT COMPLEXITY CLASSIFICATIONS THAT ARE ALIGNED WITH TARGETED TEXT COMPLEXITY STANDARDSETS Research Report Series, 2010
- A Case Study on an Item Writing Process: Use of Test Specifications, Nature of Group Dynamics, and Individual Item Writers' CharacteristicsLanguage Assessment Quarterly, 2010
- Language Testing and Assessment2006
- Some Guidelines for Conducting Quantitative and Qualitative Research in TESOLTESOL Quarterly, 2003
- A Review of Multiple-Choice Item-Writing Guidelines for Classroom AssessmentApplied Measurement in Education, 2002
- A New Academic Word ListTESOL Quarterly, 2000
- Test Item Development: Validity Evidence From Quality Assurance ProceduresApplied Measurement in Education, 1997
- How Much Lexis is Necessary for Reading Comprehension?1992
- Derivation of New Readability Formulas (Automated Readability Index, Fog Count and Flesch Reading Ease Formula) for Navy Enlisted Personnel1975