Real-Time Musical Haptics With Ultra-Wideband: A Study on Latency, Reliability, and Perception
Open Access
- 6 January 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Haptics
- Vol. 18 (1) , 269-280
Abstract
Ultra-wideband (UWB) radios are popular for accurate distance estimation between devices. However, UWB also offers low-power, fast, reliable wireless communication. We exploit it here in a real-time musical haptics system for live performances: a wearable, wirelessly activated via UWB by the performer's instrument, augments the audience musical experience with a tactile sensory layer. Two challenges are crucial to the experience quality: i ) communication must be reliable, to prevent corruption of tactile signals, and ii ) these must reach the audience synchronously with the instrument sounds. We perform micro-benchmarks of UWB links alone in a controlled setup, showing that the haptic signal can be delivered reliably over UWB before the instrument sound, thus enabling proper compensation delays to perfectly realign sound and tactile vibration. We confirm this holds on the end-to-end system including haptic components by characterizing four proof-of-concept prototypes combining different UWB-enabled instruments and wearables. Finally, we reconcile these objective measures with subjective ones via a user study focusing on perception , yielding very positive outcomes. Together, these results confirm the potential of UWB-based musical haptics for enhancing the audience experience at live performances in ways hitherto unexplored.Keywords
Funding Information
- Italian government via the NG-UWB project
- European Union—Next Generation EU
- Italian National Recovery and Resilience Plan (B53C22003970001)
This publication has 33 references indexed in Scilit:
- A Survey of Indoor Location Technologies, Techniques and Applications in IndustryInternet of Things, 2022
- Touching the audience: musical haptic wearables for augmented and participatory live music performancesPersonal and Ubiquitous Computing, 2020
- Internet of Musical Things: Vision and ChallengesIEEE Access, 2018
- Musical Haptics2018
- Haptic-assistive technologies for audition and vision sensory disabilitiesDisability and Rehabilitation: Assistive Technology, 2017
- Augmented Opera Performance2013
- Actuator Design2009
- Adaptation to audiotactile asynchronyNeuroscience Letters, 2007
- Cutaneous Grooves: Composing for the Sense of TouchJournal of New Music Research, 2003
- Perceived order in different sense modalities.Journal of Experimental Psychology, 1961