”It’s like a puppet master”: User Perceptions of Personal Autonomy when Interacting with Intelligent Technologies
Authors:
Open Access
- 21 June 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 108-118
Abstract
Applications which use some form of artificial intelligence (AI) have become embedded in our everyday interactions. Very often, AI-based apps are personalized and modelled on users’ needs and preferences. However, such applications of AI tread a delicate balance between enhancing user experience and jeopardizing personal autonomy. Personal autonomy and sense of agency are crucial for human well-being and development. In this paper, we probe this fine balance aiming to capture users’ lived experiences and perceptions of interacting with AI-based apps. We present insights from a phenomenological study (N=15) regarding users’ perception of personal autonomy when interacting with AI in everyday contexts. We found that these experiences are transitory and largely influenced by contextual factors. Users experience a loss of autonomy when their privacy or identity is threatened or when their expectations are broken. To mitigate such loss of autonomy, mechanisms for providing intelligibility and control of AI are desired.Keywords
This publication has 24 references indexed in Scilit:
- From ‘automation’ to ‘autonomy’: the importance of trust repair in human–machine interactionErgonomics, 2018
- Understanding the privacy-personalization dilemma for web search2013
- An approach to controlling user models and personalization effects in recommender systems2013
- Evaluating Intelligibility Usage and Usefulness in a Context-Aware Application2013
- Ideas2012
- Why and why not explanations improve the intelligibility of context-aware intelligent systems2009
- Media Reach, Media Influence? The Effects of Local, National, and Internet News on Public Opinion InferencesJournalism & Mass Communication Quarterly, 2007
- The Rise of Illiberal DemocracyForeign Affairs, 1997
- The support of autonomy and the control of behavior.Journal of Personality and Social Psychology, 1987
- Phenomenological methodology in the human sciencesJournal of Religion and Health, 1984