Listening to the Voices: Describing Ethical Caveats of Conversational User Interfaces According to Experts and Frequent Users
Authors:
- Thomas MildnerTMThomas Mildner
- Orla CooneyOCOrla Cooney
- Anna-Maria MeckAMAnna-Maria Meck
- Marion BartlMBMarion Bartl
- Gian-Luca SavinoGSGian-Luca Savino
- Philip R DoylePDPhilip R Doyle
- Diego GaraialdeDGDiego Garaialde
- Leigh ClarkLCLeigh Clark
- John SloanJSJohn Sloan
- Nina WenigNWNina Wenig
- Rainer MalakaRMRainer Malaka
- Jasmin NiessJNJasmin Niess
Open Access
- 11 May 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-18
Abstract
Advances in natural language processing and understanding have led to a rapid growth in the popularity of conversational user interfaces (CUIs). While CUIs introduce novel benefits, they also yield risks that may exploit people’s trust. Although research looking at unethical design deployed through graphical user interfaces (GUIs) established a thorough understanding of so-called dark patterns, there is a need to continue this discourse within the CUI community to understand potentially problematic interactions. Addressing this gap, we interviewed 27 participants from three cohorts: researchers, practitioners, and frequent users of CUIs. Applying thematic analysis, we construct five themes reflecting each cohort’s insights about ethical design challenges and introduce the CUI Expectation Cycle, bridging system capabilities and user expectations while considering each theme’s ethical caveats. This research aims to inform future development of CUIs to consider ethical constraints while adopting a human-centred approach.Keywords
All Related Versions
This publication has 86 references indexed in Scilit:
- The present looks nothing like the Jetsons: Deceptive design in virtual assistants and the protection of the rights of usersComputer Law & Security Review, 2023
- Racial disparities in automated speech recognitionProceedings of the National Academy of Sciences, 2020
- A Taxonomy of Social Cues for Conversational AgentsInternational Journal of Human-Computer Studies, 2019
- Thematic Analysis2019
- Voice anthropomorphism, interlocutor modelling and alignment effects on syntactic choices in human−computer dialogueInternational Journal of Human-Computer Studies, 2015
- Value Sensitive Design and Information Systems2013
- Most people are not WEIRDNature, 2010
- Construction and Evaluation of a User Experience Questionnaire2008
- Modeling a paranoid mindBehavioral and Brain Sciences, 1981
- Effect of expectation and disconfirmation on postexposure product evaluations: An alternative interpretation.Journal of Applied Psychology, 1977