Do pseudoword false alarm rates and overestimation rates in Yes/No vocabulary tests change with Japanese university students’ English ability levels?
Author:
- 8 March 2012
- journal article
- Published by SAGE Publications in Language Testing
- Vol. 29 (4) , 471-488
Abstract
Pseudowords, or non-real words, were introduced to the Yes/No (YN) vocabulary test format to provide a means of checking for overestimation of word knowledge by test takers. The purpose of this study is to assess the assumption that more pseudoword checks (false alarms) indicate more instances of overestimation of word knowledge in YN tests. Thirty English classes in five different Japanese universities with TOEIC® scores ranging from 230 to 730 participated (n = 490). YN test results were compared with a multiple-choice test of the same 96 real words to provide a way to check directly for instances of underestimation and overestimation of word knowledge on the YN tests. Results showed that students from the higher proficiency universities had a slightly higher pseudoword false alarm rate than students from the lower ability universities (4.28% and 3.96%, respectively). However, overestimation rates were considerably lower for these same students from the higher proficiency universities (3.24% and 5.67%, respectively). This discrepancy between false alarm rates and overestimation rates questions the value of pseudowords for measuring overestimation in YN vocabulary tests when student ability levels differ significantly.Keywords
This publication has 16 references indexed in Scilit:
- The Effects of Receptive and Productive Learning of Word Pairs on Vocabulary KnowledgeRELC Journal, 2009
- The on-line Yes/No test as a placement toolSystem, 2009
- Developing an Integrated Diagnostic Test of Vocabulary Size and DepthRELC Journal, 2009
- Measuring vocabulary size in English as an additional languageLanguage Teaching Research, 2002
- Examining the Yes/No vocabulary test: some methodological issues in theory and practiceLanguage Testing, 2001
- Developing and exploring the behaviour of two new versions of the Vocabulary Levels TestLanguage Testing, 2001
- A New Academic Word ListTESOL Quarterly, 2000
- Assessing Japanese college students' vocabulary knowledge with a self-checking familiarity surveySystem, 1999
- The development of a new measure of L2 vocabulary knowledgeLanguage Testing, 1993
- An alternative to multiple choice vocabulary testsLanguage Testing, 1987