Beyond Audio: Towards a Design Space of Headphones as a Site for Interaction and Sensing
Open Access
- 10 July 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 904-916
Abstract
Via Research through Design (RtD), we explore the potential of headphones as a general-purpose input device for both foreground motion-gestures as well as background sensing of user activity. As a familiar wearable device, headphones offer a compelling site for head-situated interaction and sensing. Using emerging sensing modalities such as inertial motion, capacitive touch sensing, and depth cameras, our implemented prototypes explore sensing and interaction techniques that offer a range of compelling capabilities. User scenarios include context-aware privacy, gestural audio-visual control, and co-opting natural body language as context to drive animated avatars for "camera-off" scenarios in remote work–or to co-opt (oft-subconscious) head movements such as dodging attacks in video games to enhance the gameplay experience. Drawing from literature and other frameworks, we situate our prototypes and related techniques in a design space across the dual dimensions of (1) type of input (touch, mid-air, or head orientation); and (2) the context of user action (application, body, or environment). In particular, interactions that combine multiple inputs and contexts at the same time offer a rich design space of headphone-situated wearable interactions and sensing techniques.Keywords
This publication has 59 references indexed in Scilit:
- Materiality matters---experience materialsInteractions, 2013
- Annotated portfoliosInteractions, 2012
- Proxemic interactionsInteractions, 2011
- Effects of damping head movement and facial expression in dyadic conversation using real–time facial expression tracking and synthesized avatarsPhilosophical Transactions of the Royal Society B: Biological Sciences, 2009
- The Design of Implicit Interactions: Making Interactive Systems Less ObnoxiousDesign Issues, 2008
- Cracking the Nonverbal CodeJournal of Cross-Cultural Psychology, 2005
- Foreground and background interaction with sensor-enhanced mobile devicesACM Transactions on Computer-Human Interaction, 2005
- Fractured Ecologies: Creating Environments for CollaborationHuman–Computer Interaction, 2003
- Distributed cognitionACM Transactions on Computer-Human Interaction, 2000
- Social translucenceACM Transactions on Computer-Human Interaction, 2000