How People Living With Amyotrophic Lateral Sclerosis Use Personalized Automatic Speech Recognition Technology to Support Communication
Author:
Open Access
- 7 November 2024
- journal article
- research article
- Published by American Speech Language Hearing Association in Journal of Speech, Language, and Hearing Research
- Vol. 67 (11) , 4186-4202
Abstract
Purpose: Amyotrophic lateral sclerosis (ALS) is a progressive, ultimately fatal disease causing progressive muscular weakness. Most people living with ALS (plwALS) experience dysarthria, eventually becoming unable to communicate using natural speech. Many wish to use speech for as long as possible. Personalized automated speech recognition (ASR) model technology, such as Google's Project Relate, is argued to better recognize speech with dysarthria, supporting maintenance of understanding through real-time captioning. The objectives of this study are how plwALS and communication partners use Relate in everyday conversation over a period of up to 12 months and how it may change with any decline in speech over time. Method: This study videoed interactions between three plwALS and communication partners. We assessed ASR caption accuracy and how well they preserved meaning. Conversation analysis was used to identify participants' own organizational practices in the accomplishment of interaction. Thematic analysis was used to understand better the participants' experiences of using ASR captions. Results: All plwALS reported lower-than-expected ASR accuracy when used in conversation and felt ASR captioning was only useful in certain contexts. All participants liked the concept of live captioning and were hopeful that future improvements to ASR accuracy may support their communication in everyday life. Conclusions: Training is needed on best practices for customization and practical use of ASR technology and for the limitations of ASR in conversational settings. Support is needed for those less confident with technology and to reduce misplaced allocation of ownership of captioning errors, risking negative effects on psychological well-being.Keywords
This publication has 37 references indexed in Scilit:
- Person Reference as a Trouble Source in Dysarthric Talk-in-Interaction2020
- New and emerging access technologies for adults with complex communication needs and severe motor impairments: State of the scienceAugmentative and Alternative Communication, 2019
- Brain-Computer Interface Users Speak Up: The Virtual Users' Forum at the 2013 International Brain-Computer Interface MeetingArchives of Physical Medicine and Rehabilitation, 2015
- Evolutionary approach for integration of multiple pronunciation patterns for enhancement of dysarthric speech recognitionExpert Systems with Applications, 2014
- AAC for adults with acquired neurological conditions: A reviewAugmentative and Alternative Communication, 2007
- Glossary of transcript symbols with an introduction2004
- Acceptance of Augmentative and Alternative Communication Technology by Persons with Amyotrophic Lateral SclerosisAugmentative and Alternative Communication, 2004
- Communication effectiveness of individuals with amyotrophic lateral sclerosisJournal of Communication Disorders, 2004
- The Understandability of AAC: A Conversation Analysis Study of Acquired DysarthriaAugmentative and Alternative Communication, 2004
- "I Prefer Contact This Close": Perceptions of AAC by People with Motor Neurone Disease and their Communication PartnersAugmentative and Alternative Communication, 2004