Examining the Yes/No vocabulary test: some methodological issues in theory and practice
Authors:
Open Access
- 1 July 2001
- journal article
- research article
- Published by SAGE Publications in Language Testing
- Vol. 18 (3) , 235-274
Abstract
This article evaluates the characteristics of the Yes/No test as a measure for receptive vocabulary size in second language (L2). This evaluation was conducted both on theoretical grounds as well as on the basis of a large corpus of data collected with French learners of Dutch. The study focuses on the internal qualities of the format in comparison with other more classical test formats. The central issue of determining a meaningful test score is addressed by providing a theoretical framework distinguishing discrete from continuous models. Correction formulae based on the discrete approach are shown to differ when applied to the Yes/No test in comparison with Multiple Choice (MC) or True/False formats. Correction formulae based on the continuous approach take the response bias into account but certain underlying assumptions need to be validated. It is shown that both correction schemes display several shortcomings and that most of the data relative to the reliability of the Yes/No test presented in the literature are overestimated. Finally, several future research options are proposed in order to attain a straightforward but reliable and valid instrument for measuring receptive vocabulary size.Keywords
This publication has 14 references indexed in Scilit:
- Psychological Science Can Improve Diagnostic DecisionsPsychological Science in the Public Interest, 2000
- Assessing Vocabulary2000
- Triangles in ROC space: History and theory of “nonparametric” measures of sensitivity and response biasPsychonomic Bulletin & Review, 1996
- The development of a new measure of L2 vocabulary knowledgeLanguage Testing, 1993
- An alternative to multiple choice vocabulary testsLanguage Testing, 1987
- The Role of Vocabulary TeachingTESOL Quarterly, 1976
- Nonparametric index of response bias for use in detection and recognition experiments.Psychological Bulletin, 1970
- On the equivalence of two recognition measures of short-term memory.Psychological Bulletin, 1966
- A decision-making theory of visual detection.Psychological Review, 1954
- The Reliability and Validity of Four Types of Vocabulary TestsThe Journal of Educational Research, 1929