Assessing the use of multiple-choice translation items in English proficiency tests: The case of the national English proficiency test in Turkey
- 8 October 2019
- journal article
- research article
- Published by Walter de Gruyter GmbH in Applied Linguistics Review
- Vol. 13 (4) , 461-475
Abstract
The use of translation for language teaching and assessment, by and large, has been abandoned with the adoption of audio-lingual and communicative approaches in language teaching. As a result, nowadays translation items are not commonly used for measuring language proficiency in international language proficiency tests (e. g. TOEFL, IELTS). However, there are several countries that still use translation items in their national language proficiency tests (e. g. Turkey, Japan, China, Romania among others). The present study aims to examine whether or not multiple-choice translation items are an appropriate tool for measuring proficiency in English. To this end, the perceived level of difficulty and validity of multiple-choice translation items in the National English Proficiency Test (YDS) in Turkey were examined. The findings revealed that the participants did significantly better on the translation items than on the rest of the test items. They also perceived the translation items as the easiest among all the rest items in YDS. Moreover, while YDS as a whole indicated a strong validity based on correlation with TOEFL PBT Reading Sample Test, the translation items indicated moderate validity. Importantly, there was a significant difference between the two correlations. These findings suggest that multiple-choice translation items are likely to lower the overall validity of YDS tests, inflate the scores of test-takers and, thus, might be considered as problematic for the quality of the tests.Keywords
This publication has 14 references indexed in Scilit:
- Correlation Coefficients: Appropriate Use and InterpretationAnesthesia & Analgesia, 2018
- cocor: A Comprehensive Solution for the Statistical Comparison of CorrelationsPLOS ONE, 2015
- Fitting Linear Mixed-Effects Models Usinglme42015
- Introducing Translation Studies2013
- Language Testing and Validation2005
- Approaches and Methods in Language Teaching2001
- Comparative Stylistics of French and English1995
- Translation as a language testing procedure: does it work?Language Testing, 1992
- Testing for Language TeachersThe Modern Language Journal, 1990
- Toward a science of translating: With special reference to principles and procedures involved in Bible translating. By Eugene A. Nida. Pp. x, 331. Leiden: E. J. Brill, 1964.Language, 1966