Dynamic Norming for Systematic Analysis of Language Transcripts
- 12 January 2022
- journal article
- research article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 65 (1) , 320-333
Abstract
Purpose: This exploratory study sought to establish the psychometric stability of a dynamic norming system using the Systematic Analysis of Language Transcripts (SALT) databases. Dynamic norming is the process by which clinicians select a subset of the normative database sample matched to their individual client's demographic characteristics. Method: The English Conversation and Student-Selected Story (SSS) Narrative databases from SALT were used to conduct the analyses in two phases. Phase 1 was an exploratory examination of the standard error of measure (SEM) of six clinically relevant transcript metrics at predetermined sampling intervals to determine (a) whether the dynamic norming process resulted in samples with adequate stability and (b) the minimum sample size required for stable results. Phase 2 was confirmatory, as random samples were taken from the SALT databases to simulate clinical comparison samples. These samples were examined (a) for stability of SEM estimations and (b) to confirm the sample size findings from Phase 1. Results: Results of Phase 1 indicated that the SEMs for the six transcript metrics across both databases were low relative to each metric's scale. Samples as small as 40–50 children in the Conversation database and 20–30 children in the SSS Narrative database resulted in stable SEM estimations. Phase 2 confirmed these findings, indicating that age bands as small as ±4 months from a given center-point resulted in stable estimations provided there were approximately 35 children or more in the comparison sample. Conclusion: Psychometrically stable comparison samples can be achieved using SALT's dynamic norming system that are much smaller than the standard sample size recommended in most tests of children's language.Keywords
This publication has 25 references indexed in Scilit:
- Stability of Measures From Children's Interviews: The Effects of Time, Sample Length, and TopicAmerican Journal of Speech-Language Pathology, 2013
- Content and Form in the Narratives of Children With Specific Language ImpairmentJournal of Speech, Language, and Hearing Research, 2011
- Language sample measures and language ability in Spanish-English bilingual kindergartenersJournal of Communication Disorders, 2010
- Mean Length of Utterance Levels in 6-Month Intervals for Children 3 to 9 Years With and Without Language ImpairmentsJournal of Speech, Language, and Hearing Research, 2010
- Using Language Sample DatabasesLanguage, Speech, and Hearing Services in Schools, 2010
- A cross-linguistic and bilingual evaluation of the interdependence between lexical and grammatical domainsApplied Psycholinguistics, 2009
- Productivity, Fluency, and Grammaticality Measures From NarrativesCommunication Disorders Quarterly, 2007
- The Diagnostic and Predictive Validity of The Renfrew Bus StoryLanguage, Speech, and Hearing Services in Schools, 2007
- Determining the Adequacy of Tests of Children's LanguageCommunication Disorders Quarterly, 2005
- Language sampling for kindergarten children with and without SLI: mean length of utterance, IPSYN, and NDWJournal of Communication Disorders, 2005