Lexical Frequency Profiles and Zipf's Law
- 1 March 2011
- journal article
- Published by Wiley in Language Learning
- Vol. 61 (1) , 1-30
Abstract
Laufer and Nation (1995) proposed that the Lexical Frequency Profile (LFP) can estimate the size of a second‐language writer's productive vocabulary. Meara (2005) questioned the sensitivity and the reliability of LFPs for estimating vocabulary sizes, based on the results obtained from probabilistic simulations of LFPs. However, the underlying mathematical model for the simulations, based on Zipf's law, allows such an analysis to be done directly, without recourse to simulations. The direct analysis has the further advantage of demonstrating how variability estimates obtained from within the 1k band (the 1,000 most frequent words of English) portion of written texts may explain the simulation results. The findings confirm that the ability of LFPs to distinguish between groups diminishes as vocabulary size increases. However, for fairly homogeneous groups, LFPs are able to provide a coarse but reasonable tool for vocabulary size estimation. We also explore modifications to Zipf's law that may result in a more accurate model of word frequencies in natural language.Keywords
This publication has 19 references indexed in Scilit:
- From Faible to Strong: How Does Their Vocabulary Grow?The Canadian Modern Language Review, 2006
- Lexical Frequency Profiles: From Monte Carlo to the Real WorldApplied Linguistics, 2005
- Nonlinear Dynamics in Physiology and Medicine2003
- Two Regimes in the Frequency of Words and the Origins of Complex Lexicons: Zipf’s Law Revisited∗Journal of Quantitative Linguistics, 2001
- Scale invariance in biology: coincidence or footprint of a universal mechanism?Biological Reviews, 2001
- A New Academic Word ListTESOL Quarterly, 2000
- A vocabulary-size test of controlled productive abilityLanguage Testing, 1999
- Vocabulary Size and Use: Lexical Richness in L2 Written ProductionApplied Linguistics, 1995
- Markov Processes: Linguistics and Zipf's LawPhysical Review Letters, 1995
- How Large Can a Receptive Vocabulary Be?Applied Linguistics, 1990