Many-to-One Gesture-to-Command Flexible Mapping Approach for Smart Teaching Interface Interaction
Open Access
- 3 December 2019
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Access
- Vol. 7, 179517-179531
Abstract
Mapping between gestures and semantics is inherently challenging, especially in the aspect of defining meaningful gesture semantics that are easy to understand and remember. To address this challenge, we put forward an intent-driven approach in this paper, which is based on users’ interaction intent. We implemented a many-to-one flexible mapping between multiple gestures and one semantic object. We also designed and evaluated a domain-specific gestural input technique for classroom use by considering the intent of the user. The main contributions of this work consist of: (1) a mapping between multiple gestures and one semantics and (2) an intelligent and natural interacting interface model for a three-dimensional (3D) user interfaces (UIs). The proposed algorithm is evaluated with five frequently used gestures and applied to the UIs system. The experimental results demonstrate that the gesture-based algorithm performs well and can substantially reduce the memory loads of the user.Keywords
Funding Information
- National Basic Research Program of China (2018YFB1004901)
- National Natural Science Foundation of China (U1705262, 61772443, 61572410, 61802324, 61702136)
This publication has 33 references indexed in Scilit:
- Robust gesture recognition using Kinect: A comparison between DTW and HMMOptik, 2015
- Reduction in gesture during the production of repeated referencesJournal of Memory and Language, 2015
- The design of hand gestures for human–computer interaction: Lessons from sign language interpretersInternational Journal of Human-Computer Studies, 2014
- Towards successful user interaction with systems: Focusing on user-derived gestures for smart home systemsApplied Ergonomics, 2014
- Real-time oriented behavior-driven 3D freehand tracking for direct interactionPattern Recognition, 2013
- Respiratory sinus arrhythmia as a measure of cognitive workloadInternational Journal of Psychophysiology, 2012
- User-adaptive hand gesture recognition system with interactive trainingImage and Vision Computing, 2005
- Human-Computer Interaction System with Artificial Neural Network Using Motion Tracker and Data GloveLecture Notes in Computer Science, 2005
- Movement phases in signs and co-speech gestures, and their transcription by human coders1998
- Tivoli: An Electronic Whiteboard for Informal Workgroup Meetings1995