Designing and Evaluating Hand-to-Hand Gestures with Dual Commodity Wrist-Worn Devices
Authors:
Open Access
- 18 March 2020
- journal article
- research article
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 4 (1) , 1-27
Abstract
Hand gestures provide a natural and easy-to-use way to input commands. However, few works have studied the design space of bimanual hand gestures or attempted to infer gestures that involve devices on both hands. We explore the design space of hand-to-hand gestures, a group of gestures that are performed by touching one hand with the other hand. Hand-to-hand gestures are easy to perform and provide haptic feedback on both hands. Moreover, hand-to-hand gestures generate simultaneous vibration on two hands that can be sensed by dual off-the-shelf wrist-worn devices. In this work, we derive a hand-to-hand gesture vocabulary with subjective ratings from users and select gesture sets for real-life scenarios. We also take advantage of devices on both wrists to demonstrate their gesture-sensing capability. Our results show that the recognition accuracy for fourteen gestures is 94.6% when the user is stationary, and the accuracy for five gestures is 98.4% or 96.3% when the user is walking or running, respectively. This is significantly more accurate than a single device worn on either wrist. Our further evaluation also validates that users can easily remember hand-to-hand gestures and use our technique to invoke commands in real-life contexts.Keywords
Funding Information
- the Natural Science Foundation of China (61521002,61672314)
- National Key Research and Development Plan (2016YFB1001200)
- Beijing Key Lab of Networked Multimedia
This publication has 62 references indexed in Scilit:
- MIME2015
- Botential2015
- An Elicitation Study on Gesture Preferences and Memorability Toward a Practical Hand-Gesture Vocabulary for Smart TelevisionsIEEE Access, 2015
- Myopoint2015
- WearablesCommunications of the ACM, 2014
- Reducing legacy bias in gesture elicitation studiesInteractions, 2014
- I'm home: Defining and evaluating a gesture set for smart-home controlInternational Journal of Human-Computer Studies, 2011
- Shake Well Before Use: Authentication Based on Accelerometer Data2007
- The magical number seven, plus or minus two: Some limits on our capacity for processing information.Psychological Review, 1994
- Asymmetric Division of Labor in Human Skilled Bimanual ActionJournal of Motor Behavior, 1987