"It feels like hard work trying to talk to it": Understanding Older Adults' Experiences of Encountering and Repairing Conversational Breakdowns with AI Systems
Preprint
Abstract
Designing Conversational AI systems to support older adults requires more than usability and reliability, it also necessitates robustness in handling conversational breakdowns. In this study, we investigate how older adults navigate and repair such breakdowns while interacting with a voice-based AI system deployed in their homes for medication management. Through a 20-week in-home deployment with 7 older adult participant dyads, we analyzed 844 recoded interactions to identify conversational breakdowns and user-initiated repair strategies. Through findings gleaned from post-deployment interviews, we reflect on the nature of these breakdowns and older adults' experiences of mitigating them. We identify four types of conversational breakdowns and demonstrate how older adults draw on their situated knowledge and environment to make sense of and recover from these disruptions, highlighting the cognitive effort required in doing so. Our findings emphasize the collaborative nature of interactions in human-AI contexts, and point to the need for AI systems to better align with users' expectations for memory, their routines, and external resources in their environment. We conclude by discussing opportunities for AI systems to integrate contextual knowledge from older adults' sociotechnical environment and to facilitate more meaningful and user-centered interactions.Keywords
All Related Versions
This publication has 30 references indexed in Scilit:
- When combinations of humans and AI are useful: A systematic review and meta-analysisNature Human Behaviour, 2024
- A tag-based methodology for the detection of user repair strategies in task-oriented conversational agentsComputer Speech & Language, 2024
- Role play with large language modelsNature, 2023
- Older adults’ intention to use voice assistants: Usability and emotional needsHeliyon, 2023
- “I Doubt It Works!” the negative impacts of anthropomorphizing healthcare productsJournal of Business Research, 2023
- When Automation Fails: Examining the Effect of a Verbal Recovery Strategy on User Experience in Automated DrivingInternational Journal of Human–Computer Interaction, 2023
- Older adults' experiences using AlexaGeriatric Nursing, 2022
- Inductive Coding2019
- Asset based community development – enriching the lives of older citizensWorking with Older People, 2014
- On seeing human: A three-factor theory of anthropomorphism.Psychological Review, 2007