Accent, listening assessment and the potential for a shared-L1 advantage: A DIF perspective
Author:
Open Access
- 17 November 2011
- journal article
- research article
- Published by SAGE Publications in Language Testing
- Vol. 29 (2) , 163-180
Abstract
This paper reports on an investigation of the potential for a shared-L1 advantage on an academic English listening test featuring speakers with L2 accents. Two hundred and twelve second-language listeners (including 70 Mandarin Chinese L1 listeners and 60 Japanese L1 listeners) completed three versions of the University Test of English as a Second Language (UTESL) listening sub-test which featured an Australian English-accented speaker, a Japanese-accented speaker and a Mandarin Chinese-accented speaker. Differential item functioning (DIF) analyses were conducted on data from the tests which featured L2-accented speakers using two methods of DIF detection – the standardization procedure and the Mantel-Haenszel procedure – with candidates matched for ability on the test featuring the Australian English-accented speaker. Findings showed that Japanese L1 listeners were advantaged on a small number of items on the test featuring the Japanese-accented speaker, but these were balanced by items which favoured non-Japanese L1 listeners. By contrast, Mandarin Chinese L1 listeners were clearly advantaged across several items on the test featuring a Mandarin Chinese L1 speaker. The implications of these findings for claims of bias are discussed with reference to the role of speaker accent in the listening construct.Keywords
This publication has 29 references indexed in Scilit:
- Perceptual adaptation to non-native speechCognition, 2008
- Changing Communicative Needs, Revised Assessment Objectives: Testing English as an International LanguageLanguage Assessment Quarterly, 2006
- Rapid adaptation to foreign-accented EnglishThe Journal of the Acoustical Society of America, 2004
- Whose Norms? International Proficiency Tests in EnglishWorld Englishes, 2003
- The interlanguage speech intelligibility benefitThe Journal of the Acoustical Society of America, 2003
- Chinese speakers2001
- Assessing Listening2001
- Thin Versus Thick Matching in the Mantel-Haenszel Procedure for Detecting DIFJournal of Educational Statistics, 1993
- Two New Approaches to Assessing Differential Item Functioning: Standardization and the Mantel--Haenszel MethodApplied Measurement in Education, 1989
- ASSESSING UNEXPECTED DIFFERENTIAL ITEM PERFORMANCE OF FEMALE CANDIDATES ON SAT AND TSWE FORMS ADMINISTERED IN DECEMBER 1977: AN APPLICATION OF THE STANDARDIZATION APPROACH1ETS Research Report Series, 1983