Alexander M. Swiderski
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Research Interests
Alexander M. Swiderski has a total of 39 co-authors. Here are the top co-authors by number of shared publications:
- William D. Hula
Audiology and Speech Pathology Service, VA Pittsburgh Healthcare System, PA
9 shared publications - Robert Cavanaugh
School of Health & Rehabilitation Sciences, MGH Institute of Health Professions, Boston, MA
7 shared publications - Michael Walsh Dickey
Department of Communication Sciences and Disorders, University of Pittsburgh, PA
6 shared publications - William S. Evans
Department of Communication Science and Disorders, University of Pittsburgh, PA
4 shared publications Alyssa Autenreith
Audiology and Speech Pathology, Veterans Administration Pittsburgh Healthcare System, PA
3 shared publications- Emily B. Goldberg
Department of Communication Sciences and Disorders, University of Pittsburgh, PA
3 shared publications
Latest Publications
- Open Access
Concept-Level Semantic Representations Remain Decodable in Chronic Post-Stroke Aphasia
Aphasia is characterized by impaired word retrieval, yet most cognitive models of word production assume that underlying conceptual-semantic representations are largely preserved. This study investigated whether concept-level semantic structure remains decodable from BOLD signals in chronic post-stroke aphasia and which semantic models best explain neural representational geometry during covert semantic feature generation. Eight healthy adults and six individuals with chronic aphasia completed a dense-sampling fMRI protocol in which they viewed 57 pictured nouns while silently generating semantic features. Representational similarity analysis showed that an experiential model (Exp48) best matched neural geometry in both people with aphasia and controls, outperforming taxonomic (WordNet) and distributional (Word2Vec, GloVe) models. Using representational similarity decoding, concept identity was recovered well above chance in both groups. No relationship was found between decoding accuracy and language measures from individuals with aphasia. These findings suggest that experiential semantic structure remains robustly represented and decodable in chronic aphasia despite lesion-related language impairments, highlighting preserved conceptual representations alongside altered anatomy.
Open AccessConcept-Level Semantic Representations Remain Decodable in Chronic Post-Stroke Aphasia
Aphasia is characterized by impaired word retrieval, yet most cognitive models of word production assume that underlying conceptual-semantic representations are largely preserved. This study investigated whether concept-level semantic structure remains decodable from BOLD signals in chronic post-stroke aphasia and which semantic models best explain neural representational geometry during covert semantic feature generation. Eight healthy adults and six individuals with chronic aphasia completed a dense-sampling fMRI protocol in which they viewed 57 pictured nouns while silently generating semantic features. Representational similarity analysis showed that an experiential model (Exp48) best matched neural geometry in both people with aphasia and controls, outperforming taxonomic (WordNet) and distributional (Word2Vec, GloVe) models. Using representational similarity decoding, concept identity was recovered well above chance in both groups. No relationship was found between decoding accuracy and language measures from individuals with aphasia. These findings suggest that experiential semantic structure remains robustly represented and decodable in chronic aphasia despite lesion-related language impairments, highlighting preserved conceptual representations alongside altered anatomy.
- 8 July 2026
- Published by American Speech Language Hearing Association in American Journal of Speech-Language Pathology
- Vol. 35  (4) , 1807-1817
Inside Semantic Feature Analysis: A Within-Trial Analysis of Feature Quantity and Quality
Purpose: Aphasia rehabilitation increasingly emphasizes the importance of understanding the mechanisms and ingredients underlying behavioral interventions. Semantic feature analysis (SFA) is a commonly used intervention for anomia in aphasia, but there is little evidence directly examining its active ingredients. Using within-trial responses during SFA, we sought to explore how generating semantic features might facilitate naming improvements. Method: A retrospective analysis evaluated data collected from a clinical trial focused on intensive SFA treatment for individuals with chronic aphasia. The study included 44 adults with chronic aphasia following left-hemisphere stroke. A pretrained semantic model was used to estimate the semantic relatedness between features and targets. Results: Participants were 2.6 (95% confidence interval [CI; 2.16, 3.12]) times more likely to correctly name target words after engaging in feature generation. Each additional feature generated was associated with a three percentage-point increase (95% confidence interval [CI; 0.2, 0.4]) in the probability of a correct response at the end of the trial; a 1 SD increase in semantic similarity (i.e., feature quality) was associated with a six percentage-point increase (95% CI [0.4, 0.10]). Model comparison favored semantic similarity over feature generation count in predicting final response accuracy. Conclusions: Findings provide converging evidence that semantic feature generation is an active ingredient in SFA treatment, emphasizing the importance of feature quantity and semantic quality, consistent with a spreading activation account of SFA's benefits. Further research is warranted to validate relatedness values from semantic model embeddings and to explore the relationship between within-trial feature generation and generalization to semantically related but untreated words. Supplemental Material: https://doi.org/10.23641/asha.32159406
- 8 July 2026
- Published by American Speech Language Hearing Association in American Journal of Speech-Language Pathology
- Vol. 35  (4) , 1807-1817
Inside Semantic Feature Analysis: A Within-Trial Analysis of Feature Quantity and Quality
Purpose: Aphasia rehabilitation increasingly emphasizes the importance of understanding the mechanisms and ingredients underlying behavioral interventions. Semantic feature analysis (SFA) is a commonly used intervention for anomia in aphasia, but there is little evidence directly examining its active ingredients. Using within-trial responses during SFA, we sought to explore how generating semantic features might facilitate naming improvements. Method: A retrospective analysis evaluated data collected from a clinical trial focused on intensive SFA treatment for individuals with chronic aphasia. The study included 44 adults with chronic aphasia following left-hemisphere stroke. A pretrained semantic model was used to estimate the semantic relatedness between features and targets. Results: Participants were 2.6 (95% confidence interval [CI; 2.16, 3.12]) times more likely to correctly name target words after engaging in feature generation. Each additional feature generated was associated with a three percentage-point increase (95% confidence interval [CI; 0.2, 0.4]) in the probability of a correct response at the end of the trial; a 1 SD increase in semantic similarity (i.e., feature quality) was associated with a six percentage-point increase (95% CI [0.4, 0.10]). Model comparison favored semantic similarity over feature generation count in predicting final response accuracy. Conclusions: Findings provide converging evidence that semantic feature generation is an active ingredient in SFA treatment, emphasizing the importance of feature quantity and semantic quality, consistent with a spreading activation account of SFA's benefits. Further research is warranted to validate relatedness values from semantic model embeddings and to explore the relationship between within-trial feature generation and generalization to semantically related but untreated words. Supplemental Material: https://doi.org/10.23641/asha.32159406
- Open Access
- 18 January 2026
- Published by Center for Open Science in PsyArXiv
Inside Semantic Feature Analysis: A Within-Trial Analysis of Feature Quantity and Quality
Purpose: Aphasia rehabilitation increasingly emphasizes the importance of understanding the mechanisms and ingredients underlying behavioral interventions. Semantic Feature Analysis (SFA) is a commonly-used intervention for anomia in aphasia but there is little evidence directly examining its active ingredients. Using within-trial responses during SFA, we sought to explore how generating semantic features might facilitate naming improvements. Method: A retrospective analysis evaluated data collected from a clinical trial focused on intensive SFA treatment for individuals with chronic aphasia. The study included 44 adults with chronic aphasia following left-hemisphere stroke. A pre-trained semantic model was used to estimate the semantic relatedness between features and targets.Results: Participants were 2.6 (95% CI: [2.16, 3.12]) times more likely to correctly name target words after engaging in feature generation. Each additional feature generated was associated with a three percentage-point increase (95% CI: [0.2, 0.4]) in the probability of a correct response at the end of the trial; a one standard deviation increase in semantic similarity (i.e., feature quality) was associated with a six percentage-point increase (95% CI: [0.4, 0.10]). Model comparison favored semantic similarity over feature generation count in predicting final response accuracy.Conclusions: Findings provide converging evidence that semantic feature generation is an active ingredient in SFA treatment, emphasizing the importance of feature quantity and semantic quality, consistent with a spreading activation account of SFA’s benefits. Further research is warranted to validate relatedness values from semantic model embeddings, and to explore the relationship between within-trial feature generation and generalization to semantically related but untreated words.
- 18 January 2026
- Published by Center for Open Science in PsyArXiv
Open AccessInside Semantic Feature Analysis: A Within-Trial Analysis of Feature Quantity and Quality
Purpose: Aphasia rehabilitation increasingly emphasizes the importance of understanding the mechanisms and ingredients underlying behavioral interventions. Semantic Feature Analysis (SFA) is a commonly-used intervention for anomia in aphasia but there is little evidence directly examining its active ingredients. Using within-trial responses during SFA, we sought to explore how generating semantic features might facilitate naming improvements. Method: A retrospective analysis evaluated data collected from a clinical trial focused on intensive SFA treatment for individuals with chronic aphasia. The study included 44 adults with chronic aphasia following left-hemisphere stroke. A pre-trained semantic model was used to estimate the semantic relatedness between features and targets.Results: Participants were 2.6 (95% CI: [2.16, 3.12]) times more likely to correctly name target words after engaging in feature generation. Each additional feature generated was associated with a three percentage-point increase (95% CI: [0.2, 0.4]) in the probability of a correct response at the end of the trial; a one standard deviation increase in semantic similarity (i.e., feature quality) was associated with a six percentage-point increase (95% CI: [0.4, 0.10]). Model comparison favored semantic similarity over feature generation count in predicting final response accuracy.Conclusions: Findings provide converging evidence that semantic feature generation is an active ingredient in SFA treatment, emphasizing the importance of feature quantity and semantic quality, consistent with a spreading activation account of SFA’s benefits. Further research is warranted to validate relatedness values from semantic model embeddings, and to explore the relationship between within-trial feature generation and generalization to semantically related but untreated words.
- 11 November 2025
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 68  (11) , 5384-5398
Cognitive Functions Supporting Learning Over Time in Naming Treatment for Aphasia
Purpose: Aphasia rehabilitation is a learning process that unfolds over time. Previous group studies have examined aphasia treatment response using pre- to posttreatment comparison, largely ignoring the unfolding learning response that occurs session-to-session. We aimed to (a) characterize the shape of learning while individuals with aphasia received intensive anomia intervention and (b) identify the cognitive predictors of this learning response. Method: Individuals ( N = 39) with chronic poststroke aphasia received intensive semantic feature analysis (SFA). Naming accuracy for trained and semantically related, untrained words was probed daily. We used Bayesian generalized linear mixed-effects models to estimate the shape of learning during SFA treatment and to measure the influence of key cognitive functions on treatment response. Results: Most treatment gains appeared early during treatment, after the first 4 hr of intervention. Verbal recognition and visuospatial memory were associated with the magnitude of those early treatment gains, favoring strong cognitive performers. Treatment generalization to untrained targets was present but modest, with some evidence suggesting that visuospatial recall performance may be associated with treatment generalization. Conclusions: Monitoring SFA treatment response early could help inform clinicians whether patients will respond optimally to intervention. Verbal recognition and visuospatial recall support learning during treatment, helping elucidate cognitive underpinnings of learning during aphasia rehabilitation. Supplemental Material: https://doi.org/10.23641/asha.30213520
- 11 November 2025
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 68  (11) , 5384-5398
Cognitive Functions Supporting Learning Over Time in Naming Treatment for Aphasia
Purpose: Aphasia rehabilitation is a learning process that unfolds over time. Previous group studies have examined aphasia treatment response using pre- to posttreatment comparison, largely ignoring the unfolding learning response that occurs session-to-session. We aimed to (a) characterize the shape of learning while individuals with aphasia received intensive anomia intervention and (b) identify the cognitive predictors of this learning response. Method: Individuals ( N = 39) with chronic poststroke aphasia received intensive semantic feature analysis (SFA). Naming accuracy for trained and semantically related, untrained words was probed daily. We used Bayesian generalized linear mixed-effects models to estimate the shape of learning during SFA treatment and to measure the influence of key cognitive functions on treatment response. Results: Most treatment gains appeared early during treatment, after the first 4 hr of intervention. Verbal recognition and visuospatial memory were associated with the magnitude of those early treatment gains, favoring strong cognitive performers. Treatment generalization to untrained targets was present but modest, with some evidence suggesting that visuospatial recall performance may be associated with treatment generalization. Conclusions: Monitoring SFA treatment response early could help inform clinicians whether patients will respond optimally to intervention. Verbal recognition and visuospatial recall support learning during treatment, helping elucidate cognitive underpinnings of learning during aphasia rehabilitation. Supplemental Material: https://doi.org/10.23641/asha.30213520
- 10 July 2025
- Published by American Speech Language Hearing Association in American Journal of Speech-Language Pathology
- Vol. 34  (4) , 2081-2097
Interim Treatment Fidelity for a Randomized Controlled Comparative Effectiveness Trial of Two Variants of Semantic Feature Analysis Treatment for Aphasia
Purpose: This study evaluated treatment fidelity for an ongoing randomized controlled trial comparing two variants of semantic feature analysis (SFA) treatment for naming impairment in aphasia. In this trial, participants are being randomized to treatment conditions (many- or few-features) in which they are asked to generate either 11 or five features per SFA trial. Method: Treatment fidelity was addressed via study design, manualization of the treatment, provider training, and maintenance of daily treatment logs, among other approaches. Fidelity was assessed through protocol adherence checks, interrater reliability of feature counting, and analysis of treatment dosage. Protocol adherence was measured using a 20-item checklist. Interrater reliability was evaluated for feature counts on 10% of treatment sessions. Treatment dosage was analyzed to confirm differentiation between many-features and few-features groups in terms of features generated and exposed and equivalence in terms of total treatment time. Results: Overall protocol adherence was 99%. Interrater reliability for feature counting showed good-to-excellent agreement. Analysis of treatment dosage in terms of features per trial confirmed clear differentiation between groups, with the many-features group generating or being exposed to approximately 10–11 features per trial compared to four to five features for the few-features group. Analysis of other aspects of dosage also suggested good fidelity to the design. Conclusions: This ongoing trial of SFA is being implemented with high levels of treatment fidelity. The study demonstrates the importance and feasibility of comprehensive fidelity monitoring in aphasia treatment research. Detailed fidelity procedures and outcomes support interpretation, replication, and clinical implementation of study findings. Supplemental Material: https://doi.org/10.23641/asha.29230937
- 10 July 2025
- Published by American Speech Language Hearing Association in American Journal of Speech-Language Pathology
- Vol. 34  (4) , 2081-2097
Interim Treatment Fidelity for a Randomized Controlled Comparative Effectiveness Trial of Two Variants of Semantic Feature Analysis Treatment for Aphasia
Purpose: This study evaluated treatment fidelity for an ongoing randomized controlled trial comparing two variants of semantic feature analysis (SFA) treatment for naming impairment in aphasia. In this trial, participants are being randomized to treatment conditions (many- or few-features) in which they are asked to generate either 11 or five features per SFA trial. Method: Treatment fidelity was addressed via study design, manualization of the treatment, provider training, and maintenance of daily treatment logs, among other approaches. Fidelity was assessed through protocol adherence checks, interrater reliability of feature counting, and analysis of treatment dosage. Protocol adherence was measured using a 20-item checklist. Interrater reliability was evaluated for feature counts on 10% of treatment sessions. Treatment dosage was analyzed to confirm differentiation between many-features and few-features groups in terms of features generated and exposed and equivalence in terms of total treatment time. Results: Overall protocol adherence was 99%. Interrater reliability for feature counting showed good-to-excellent agreement. Analysis of treatment dosage in terms of features per trial confirmed clear differentiation between groups, with the many-features group generating or being exposed to approximately 10–11 features per trial compared to four to five features for the few-features group. Analysis of other aspects of dosage also suggested good fidelity to the design. Conclusions: This ongoing trial of SFA is being implemented with high levels of treatment fidelity. The study demonstrates the importance and feasibility of comprehensive fidelity monitoring in aphasia treatment research. Detailed fidelity procedures and outcomes support interpretation, replication, and clinical implementation of study findings. Supplemental Material: https://doi.org/10.23641/asha.29230937
- Open Access
Cognitive functions supporting learning over time in naming treatment for aphasia
Purpose: Aphasia rehabilitation is a learning process that unfolds over time. Previous work has examined aphasia treatment response using pre- to post-treatment comparison, largely ignoring the unfolding learning response that occurs session-to-session. We aimed to: (1) characterize the shape of learning while individuals with aphasia received intensive anomia intervention, and (2) identify the cognitive predictors of this learning response. Method: Individuals (n=39) with chronic post-stroke aphasia received intensive semantic feature analysis (SFA). Naming accuracy for trained and semantically-related, untrained words was probed daily. We used Bayesian generalized linear mixed effects models to estimate the shape of learning during SFA treatment, and to measure the influence of key cognitive functions on treatment response. Results: Most treatment gains appeared early during treatment, after the first four hours of intervention. Verbal recognition and visuospatial memory were associated with the magnitude of those early treatment gains, favoring strong cognitive performers. Treatment generalization to untrained targets was present but modest, with some evidence suggesting that visuospatial recall performance may be associated with treatment generalization. Conclusions: Monitoring SFA treatment response early could help inform clinicians whether patients will respond optimally to intervention. Verbal recognition and visuospatial recall support learning during treatment, helping elucidate cognitive underpinnings of learning during aphasia rehabilitation.
Open AccessCognitive functions supporting learning over time in naming treatment for aphasia
Purpose: Aphasia rehabilitation is a learning process that unfolds over time. Previous work has examined aphasia treatment response using pre- to post-treatment comparison, largely ignoring the unfolding learning response that occurs session-to-session. We aimed to: (1) characterize the shape of learning while individuals with aphasia received intensive anomia intervention, and (2) identify the cognitive predictors of this learning response. Method: Individuals (n=39) with chronic post-stroke aphasia received intensive semantic feature analysis (SFA). Naming accuracy for trained and semantically-related, untrained words was probed daily. We used Bayesian generalized linear mixed effects models to estimate the shape of learning during SFA treatment, and to measure the influence of key cognitive functions on treatment response. Results: Most treatment gains appeared early during treatment, after the first four hours of intervention. Verbal recognition and visuospatial memory were associated with the magnitude of those early treatment gains, favoring strong cognitive performers. Treatment generalization to untrained targets was present but modest, with some evidence suggesting that visuospatial recall performance may be associated with treatment generalization. Conclusions: Monitoring SFA treatment response early could help inform clinicians whether patients will respond optimally to intervention. Verbal recognition and visuospatial recall support learning during treatment, helping elucidate cognitive underpinnings of learning during aphasia rehabilitation.
- 7 May 2024
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 67  (5) , 1548-1557
Response Latencies During Confrontation Picture Naming in Aphasia: Are Proxy Measurements Sufficient?
Purpose: Anomia, or word-finding difficulty, is a prevalent and persistent feature of aphasia, a neurogenic language disorder affecting millions of people in the United States. Anomia assessments are essential for measuring performance and monitoring outcomes in clinical settings. This study aims to evaluate the reliability of response time (RT) annotation based on spectrograms and assess the predictive utility of proxy RTs collected during computerized naming tests. Method: Archival data from 10 people with aphasia were used. Trained research assistants phonemically transcribed participants' responses, and RTs were generated from the onset of picture stimulus to the initial phoneme of the first complete attempt. RTs were measured in two ways: hand-generated RTs (from spectrograms) and proxy RTs (automatically extracted online). Interrater agreement was evaluated based on interclass correlation coefficients and generalizability theory tools including variance partitioning and the φ-coefficient. The predictive utility of proxy RTs was evaluated within a linear mixed-effects framework. Results: RT annotation reliability showed near-perfect agreement across research assistants (φ-coefficient = .93), and the variance accounted for by raters was negligible. Furthermore, proxy RTs significantly and strongly predicted hand-annotated RTs ( R 2 = ~0.82), suggesting their utility as an alternative measure. Conclusions: The study confirms the reliability of RT annotation and demonstrates the predictive utility of proxy RTs in estimating RTs during computerized naming tests. Incorporating proxy RTs can enhance clinical assessments, providing additional information for cognitive measurement. Further research with larger samples and exploring the impact of using proxy RTs in different psychometric models could optimize clinical protocols and improve communication interventions for individuals with aphasia.
- 7 May 2024
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 67  (5) , 1548-1557
Response Latencies During Confrontation Picture Naming in Aphasia: Are Proxy Measurements Sufficient?
Purpose: Anomia, or word-finding difficulty, is a prevalent and persistent feature of aphasia, a neurogenic language disorder affecting millions of people in the United States. Anomia assessments are essential for measuring performance and monitoring outcomes in clinical settings. This study aims to evaluate the reliability of response time (RT) annotation based on spectrograms and assess the predictive utility of proxy RTs collected during computerized naming tests. Method: Archival data from 10 people with aphasia were used. Trained research assistants phonemically transcribed participants' responses, and RTs were generated from the onset of picture stimulus to the initial phoneme of the first complete attempt. RTs were measured in two ways: hand-generated RTs (from spectrograms) and proxy RTs (automatically extracted online). Interrater agreement was evaluated based on interclass correlation coefficients and generalizability theory tools including variance partitioning and the φ-coefficient. The predictive utility of proxy RTs was evaluated within a linear mixed-effects framework. Results: RT annotation reliability showed near-perfect agreement across research assistants (φ-coefficient = .93), and the variance accounted for by raters was negligible. Furthermore, proxy RTs significantly and strongly predicted hand-annotated RTs ( R 2 = ~0.82), suggesting their utility as an alternative measure. Conclusions: The study confirms the reliability of RT annotation and demonstrates the predictive utility of proxy RTs in estimating RTs during computerized naming tests. Incorporating proxy RTs can enhance clinical assessments, providing additional information for cognitive measurement. Further research with larger samples and exploring the impact of using proxy RTs in different psychometric models could optimize clinical protocols and improve communication interventions for individuals with aphasia.
- 20 June 2023
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 66  (6) , 1908-1927
Reproducibility in Small- N Treatment Research: A Tutorial Using Examples From Aphasiology
Purpose: Small- N studies are the dominant study design supporting evidence-based interventions in communication science and disorders, including treatments for aphasia and related disorders. However, there is little guidance for conducting reproducible analyses or selecting appropriate effect sizes in small- N studies, which has implications for scientific review, rigor, and replication. This tutorial aims to (a) demonstrate how to conduct reproducible analyses using effect sizes common to research in aphasia and related disorders and (b) provide a conceptual discussion to improve the reader's understanding of these effect sizes. Method: We provide a tutorial on reproducible analyses of small- N designs in the statistical programming language R using published data from Wambaugh et al. (2017). In addition, we discuss the strengths, weaknesses, reporting requirements, and impact of experimental design decisions on effect sizes common to this body of research. Results: Reproducible code demonstrates implementation and comparison of within-case standardized mean difference, proportion of maximal gain, tau-U, and frequentist and Bayesian mixed-effects models. Data, code, and an interactive web application are available as a resource for researchers, clinicians, and students. Conclusions: Pursuing reproducible research is key to promoting transparency in small- N treatment research. Researchers and clinicians must understand the properties of common effect size measures to make informed decisions in order to select ideal effect size measures and act as informed consumers of small- N studies. Together, a commitment to reproducibility and a keen understanding of effect sizes can improve the scientific rigor and synthesis of the evidence supporting clinical services in aphasiology and in communication sciences and disorders more broadly. Supplemental Material and Open Science Form: https://doi.org/10.23641/asha.21699476
- 20 June 2023
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 66  (6) , 1908-1927
Reproducibility in Small- N Treatment Research: A Tutorial Using Examples From Aphasiology
Purpose: Small- N studies are the dominant study design supporting evidence-based interventions in communication science and disorders, including treatments for aphasia and related disorders. However, there is little guidance for conducting reproducible analyses or selecting appropriate effect sizes in small- N studies, which has implications for scientific review, rigor, and replication. This tutorial aims to (a) demonstrate how to conduct reproducible analyses using effect sizes common to research in aphasia and related disorders and (b) provide a conceptual discussion to improve the reader's understanding of these effect sizes. Method: We provide a tutorial on reproducible analyses of small- N designs in the statistical programming language R using published data from Wambaugh et al. (2017). In addition, we discuss the strengths, weaknesses, reporting requirements, and impact of experimental design decisions on effect sizes common to this body of research. Results: Reproducible code demonstrates implementation and comparison of within-case standardized mean difference, proportion of maximal gain, tau-U, and frequentist and Bayesian mixed-effects models. Data, code, and an interactive web application are available as a resource for researchers, clinicians, and students. Conclusions: Pursuing reproducible research is key to promoting transparency in small- N treatment research. Researchers and clinicians must understand the properties of common effect size measures to make informed decisions in order to select ideal effect size measures and act as informed consumers of small- N studies. Together, a commitment to reproducibility and a keen understanding of effect sizes can improve the scientific rigor and synthesis of the evidence supporting clinical services in aphasiology and in communication sciences and disorders more broadly. Supplemental Material and Open Science Form: https://doi.org/10.23641/asha.21699476
- 9 May 2023
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 66  (5) , 1718-1739
Item Response Theory Modeling of the Verb Naming Test
Purpose: Item response theory (IRT) is a modern psychometric framework with several advantageous properties as compared with classical test theory. IRT has been successfully used to model performance on anomia tests in individuals with aphasia; however, all efforts to date have focused on noun production accuracy. The purpose of this study is to evaluate whether the Verb Naming Test (VNT), a prominent test of action naming, can be successfully modeled under IRT and evaluate its reliability. Method: We used responses on the VNT from 107 individuals with chronic aphasia from AphasiaBank. Unidimensionality and local independence, two assumptions prerequisite to IRT modeling, were evaluated using factor analysis and Yen's Q 3 statistic (Yen, 1984), respectively. The assumption of equal discrimination among test items was evaluated statistically via nested model comparisons and practically by using correlations of resulting IRT-derived scores. Finally, internal consistency, marginal and empirical reliability, and conditional reliability were evaluated. Results: The VNT was found to be sufficiently unidimensional with the majority of item pairs demonstrating adequate local independence. An IRT model in which item discriminations are constrained to be equal demonstrated fit equivalent to a model in which unique discrimination parameters were estimated for each item. All forms of reliability were strong across the majority of IRT ability estimates. Conclusions: Modeling the VNT using IRT is feasible, yielding ability estimates that are both informative and reliable. Future efforts are needed to quantify the validity of the VNT under IRT and determine the extent to which it measures the same construct as other anomia tests. Supplemental Material: https://doi.org/10.23641/asha.22329235
- 9 May 2023
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 66  (5) , 1718-1739
Item Response Theory Modeling of the Verb Naming Test
Purpose: Item response theory (IRT) is a modern psychometric framework with several advantageous properties as compared with classical test theory. IRT has been successfully used to model performance on anomia tests in individuals with aphasia; however, all efforts to date have focused on noun production accuracy. The purpose of this study is to evaluate whether the Verb Naming Test (VNT), a prominent test of action naming, can be successfully modeled under IRT and evaluate its reliability. Method: We used responses on the VNT from 107 individuals with chronic aphasia from AphasiaBank. Unidimensionality and local independence, two assumptions prerequisite to IRT modeling, were evaluated using factor analysis and Yen's Q 3 statistic (Yen, 1984), respectively. The assumption of equal discrimination among test items was evaluated statistically via nested model comparisons and practically by using correlations of resulting IRT-derived scores. Finally, internal consistency, marginal and empirical reliability, and conditional reliability were evaluated. Results: The VNT was found to be sufficiently unidimensional with the majority of item pairs demonstrating adequate local independence. An IRT model in which item discriminations are constrained to be equal demonstrated fit equivalent to a model in which unique discrimination parameters were estimated for each item. All forms of reliability were strong across the majority of IRT ability estimates. Conclusions: Modeling the VNT using IRT is feasible, yielding ability estimates that are both informative and reliable. Future efforts are needed to quantify the validity of the VNT under IRT and determine the extent to which it measures the same construct as other anomia tests. Supplemental Material: https://doi.org/10.23641/asha.22329235
- 12 April 2023
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 66  (4) , 1351-1364
Accuracy of Naming Error Profiles Elicited From Adaptive Short Forms of the Philadelphia Naming Test
Purpose: The purpose of this study was to evaluate whether a short-form computerized adaptive testing (CAT) version of the Philadelphia Naming Test (PNT) provides error profiles and model-based estimates of semantic and phonological processing that agree with the full test. Method: Twenty-four persons with aphasia took the PNT-CAT and the full version of the PNT (hereinafter referred to as the “full PNT”) at least 2 weeks apart. The PNT-CAT proceeded in two stages: (a) the PNT-CAT30, in which 30 items were selected to match the evolving ability estimate with the goal of producing a 50% error rate, and (b) the PNT-CAT60, in which an additional 30 items were selected to produce a 75% error rate. Agreement was evaluated in terms of the root-mean-square deviation of the response-type proportions and, for individual response types, in terms of agreement coefficients and bias. We also evaluated agreement and bias for estimates of semantic and phonological processing derived from the semantic–phonological interactive two-step model (SP model) of word production. Results: The results suggested that agreement was poorest for semantic, formal, mixed, and unrelated errors, all of which were underestimated by the short forms. Better agreement was observed for correct and nonword responses. SP model weights estimated by the short forms demonstrated no substantial bias but generally inadequate agreement with the full PNT, which itself showed acceptable test–retest reliability for SP model weights and all response types except for formal errors. Discussion: Results suggest that the PNT-CAT30 and the PNT-CAT60 are generally inadequate for generating naming error profiles or model-derived estimates of semantic and phonological processing ability. Post hoc analyses suggested that increasing the number of stimuli available in the CAT item bank may improve the utility of adaptive short forms for generating error profiles, but the underlying theory also suggests that there are limitations to this approach based on a unidimensional measurement model. Supplemental Material: https://doi.org/10.23641/asha.22320814
- 12 April 2023
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 66  (4) , 1351-1364
Accuracy of Naming Error Profiles Elicited From Adaptive Short Forms of the Philadelphia Naming Test
Purpose: The purpose of this study was to evaluate whether a short-form computerized adaptive testing (CAT) version of the Philadelphia Naming Test (PNT) provides error profiles and model-based estimates of semantic and phonological processing that agree with the full test. Method: Twenty-four persons with aphasia took the PNT-CAT and the full version of the PNT (hereinafter referred to as the “full PNT”) at least 2 weeks apart. The PNT-CAT proceeded in two stages: (a) the PNT-CAT30, in which 30 items were selected to match the evolving ability estimate with the goal of producing a 50% error rate, and (b) the PNT-CAT60, in which an additional 30 items were selected to produce a 75% error rate. Agreement was evaluated in terms of the root-mean-square deviation of the response-type proportions and, for individual response types, in terms of agreement coefficients and bias. We also evaluated agreement and bias for estimates of semantic and phonological processing derived from the semantic–phonological interactive two-step model (SP model) of word production. Results: The results suggested that agreement was poorest for semantic, formal, mixed, and unrelated errors, all of which were underestimated by the short forms. Better agreement was observed for correct and nonword responses. SP model weights estimated by the short forms demonstrated no substantial bias but generally inadequate agreement with the full PNT, which itself showed acceptable test–retest reliability for SP model weights and all response types except for formal errors. Discussion: Results suggest that the PNT-CAT30 and the PNT-CAT60 are generally inadequate for generating naming error profiles or model-derived estimates of semantic and phonological processing ability. Post hoc analyses suggested that increasing the number of stimuli available in the CAT item bank may improve the utility of adaptive short forms for generating error profiles, but the underlying theory also suggests that there are limitations to this approach based on a unidimensional measurement model. Supplemental Material: https://doi.org/10.23641/asha.22320814