Using Raters From India to Score a Large‐Scale Speaking Test
Authors:
- 25 September 2011
- journal article
- Published by Wiley in Language Learning
- Vol. 61 (4) , 1222-1255
Abstract
We investigated the scoring of the Speaking section of the Test of English as a Foreign Language™ Internet‐based (TOEFL iBT®) test by speakers of English and one or more Indian languages. We explored the extent to which raters from India, after being trained and certified, were able to score the TOEFL examinees with mixed first languages accurately and consistently. The effectiveness of a special training package designed for scoring Indian examinees was examined as well. We found that the raters from India performed as well as the operational U.S.‐based raters in scoring both Indian and non‐Indian examinees. The special training also helped the raters score Indian examinees more consistently and confidently.Keywords
This publication has 25 references indexed in Scilit:
- Evaluating rater responses to an online training program for L2 writing assessmentLanguage Testing, 2007
- Individual Feedback to Enhance Rater Training: Does It Work?Language Assessment Quarterly, 2005
- Whose Norms? International Proficiency Tests in EnglishWorld Englishes, 2003
- ACCENT, INTELLIGIBILITY, AND COMPREHENSIBILITYStudies in Second Language Acquisition, 1997
- The effect of rater variables in the development of an occupation-specific language performance testLanguage Testing, 1995
- Native and Nonnative Judgments of Intelligibility and IrritationLanguage Learning, 1987
- Perceptions of the Communicative Efforts of American Students of SpanishThe Modern Language Journal, 1980
- DICTATION AS A MEASURE OF MUTUAL INTELLIGIBILITY: A PILOT STUDYLanguage Learning, 1972
- Weighted kappa: Nominal scale agreement provision for scaled disagreement or partial credit.Psychological Bulletin, 1968
- A Coefficient of Agreement for Nominal ScalesEducational and Psychological Measurement, 1960