Making Sense of the Felt Experience of Controlling Autonomous Systems
Authors:
- Hannah PelikanHPHannah Pelikan
- Airi LampinenALAiri Lampinen
- Rachael GarrettRGRachael Garrett
- Emily HofstetterEHEmily Hofstetter
- Amanda HoskinsAHAmanda Hoskins
- Hannah KuehnHKHannah Kuehn
- Iolanda LeiteILIolanda Leite
- Donald McMillanDMDonald McMillan
- Sergio PasseroSPSergio Passero
- Katie WinkleKWKatie Winkle
- Mathias BrothMBMathias Broth
- Barry BrownBBBarry Brown
Open Access
- 12 June 2026
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 4085-4100
Abstract
Methods for understanding the felt and situated experience of controlling autonomous systems are crucial for designing systems that are adjusted to the complexity of human interaction. Prior work has tended to overlook the bodily and experiential dimensions of monitoring systems at a distance, particularly in moments of losing control. We combined two approaches, ethnomethodology and conversation analysis, and soma design, to explore a case where a semi-autonomous system crashed when controlled by an inexperienced operator, captured in video ethnographic fieldwork. We report on our methodological approach, combining sequential video analysis of the unfolding sequence and interviews inspired by microphenomenology to unpack the operator’s experience of losing control. We contribute methodological considerations for interaction designers seeking to explore the felt experience of having and losing control of autonomous systems and discuss how insights gained through this combination of methods, rooted in phenomenology, support a designerly appreciation of safety operators’ work.Keywords
Funding Information
- Riksbankens Jubileumsfond (PF25-0001)
- Vetenskapsrådet (2023-04032)
- Vetenskapsrådet (2024-05867)
- Wallenberg AI, Autonomous Systems and Software Program – Humanity and Society (WASP-HS 676)
- Wallenberg AI, Autonomous Systems and Software Program – Humanity and Society (WASP-HS 808)
- Wallenberg AI, Autonomous Systems and Software Program – Humanity and Society (MMW 2019.0228)
- Riksbankens Jubileumsfond (MMW 2020.0086)
- Riksbankens Jubileumsfond (Turing AI World Leading Researcher Fellowship EP/Z534808/1)
This publication has 108 references indexed in Scilit:
- Introduction to Harold Garfinkel's Ethnomethodological "Misreading" of Aron Gurwitsch on the Phenomenal FieldHuman Studies, 2021
- Studying the experience of meditation through Micro-phenomenologyCurrent Opinion in Psychology, 2019
- Contemporary issues in conversation analysis: Embodiment and materiality, multimodality and multisensoriality in social interactionJournal of Pragmatics, 2019
- When Rules Go Awry: A Single Case Analysis of Cycle RageHuman Studies, 2017
- Ethnomethodology and Social Phenomenology2016
- Doing Design Ethnography2012
- The Phenomenal Field: Ethnomethodological Perspectives on Collective PhenomenaHuman Studies, 2008
- Fieldwork for Design2007
- Describing one’s subjective experience in the second person: An interview method for the science of consciousnessPhenomenology and the Cognitive Sciences, 2006
- Collaboration and controlCrisis management and multimedia technology in London Underground Line Control RoomsComputer Supported Cooperative Work (CSCW), 1992