Quality of Measurement in Core Lexicon Measures
Authors:
- 17 August 2022
- journal article
- research article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 65 (8) , 2919-2930
Abstract
Purpose: Core lexicon measures have received growing attention in research. They are intended to provide clinicians with a clinician-friendly means to quantify word retrieval ability in discourse based on normal expectations of discourse production for specific discourse elicitation tasks. To date, different criteria have been used to develop core lexicon measures by groups of researchers. The need for statistical guidance in pursuit of the psychologically robust measure has been recognized. Aims: This study was to investigate the best criterion for accurate measurement. Specifically, we focused on two criteria ( frequency vs. percentage ) that have previously been used for the development of core lexicon measures. Method: Core lexicon measures consisting of five different checklists by word class (verbs, nouns, adjectives, adverbs, and function words) and developed by the two criteria were applied to language samples produced by 470 cognitively healthy adults. Performance in word retrieval ability at the discourse level was modeled as a latent variable based on the observed proportions of the production of core lexicon items in two different sets of core lexicon measures using structural equation modeling. Results: Results indicated that both criterion for core lexicon measures capture word retrieval ability in discourse. Greater residual variances were found in the core lexicon measure established by the percentage criterion compared to the one established by the frequency criterion. This indicates that the measure based on the percentage criterion is more affected by measurement errors. Conclusions: The findings provide evidence that the frequency criterion is better to use for the development of core lexicon measures for core nouns, verbs, adjectives, and adverbs, but not for function words. However, our findings are limited to core lexicon measures based on language samples elicited by wordless picture books. This may not be easily applied to other core lexicon measures that use different discourse elicitation tasks due to the difference in quality and quantity of language samples. Ideally, the same approach should be replicated to evaluate the appropriateness of respective criteria in the development of core lexicon measures. Supplemental Material: https://doi.org/10.23641/asha.20304144Keywords
This publication has 25 references indexed in Scilit:
- Measuring Lexical Diversity in Narrative Discourse of People With AphasiaAmerican Journal of Speech-Language Pathology, 2013
- Lexical diversity for adults with and without aphasia across discourse elicitation tasksAphasiology, 2011
- Productive vocabulary across discourse typesAphasiology, 2011
- Story Processing Ability in Cognitively Healthy Younger and Older AdultsJournal of Speech, Language, and Hearing Research, 2011
- Automated analysis of the Cinderella storyAphasiology, 2010
- Promise and pitfalls of structural equation modeling in gifted research.2010
- Variation in the discourse of non-brain-damaged speakers on a clinical taskAphasiology, 2002
- The CHILDES Project: Tools for Analyzing Talk (third edition): Volume I: Transcription format and programs, Volume II: The databaseComputational Linguistics, 2000
- Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternativesStructural Equation Modeling: A Multidisciplinary Journal, 1999
- Discourse Performance in Older AdultsThe International Journal of Aging and Human Development, 1986