Trust in the system and human autonomy in customer service chatbots
Open Access
- 28 November 2023
- conference paper
- Published by Linkoping University Electronic Press in Swedish Aerospace Conference, FT2025
- Vol. 203, 1416-1430
Abstract
When Artificial Intelligence systems are not explained clearly to users, it can negatively affect their interactions and compromise their perceptions of a brand. When designing and developing conversational agents that deal with the client, it is crucial to consider that they are a service and follow human-centered Artificial Intelligence (HCAI) approaches. This study discusses two HCAI frameworks, relate them to trust in the system and human autonomy and define how these guidelines could be met in customer service chatbot. A survey was conducted to determine if users' views about their interactions with chatbots aligned with the recommended guidelines and how this affected their senses mentioned above. The analysis of the responses indicates that those human-centered Artificial Intelligence approaches still need to be prioritized or even met in customer service chatbot development. Users have reported unpleasant experiences with such services, leading to a decrease in their trust and autonomy.Keywords
This publication has 4 references indexed in Scilit:
- Human-Computer Interaction in Customer Service: The Experience with AI Chatbots—A Systematic Literature ReviewElectronics, 2022
- ”It’s like a puppet master”: User Perceptions of Personal Autonomy when Interacting with Intelligent Technologies2021
- Explainable AI: from black box to glass boxJournal of the Academy of Marketing Science, 2019
- Designing Product/Service Systems: A Methodological ExplorationDesign Issues, 2002