Development and Evaluation of a Low-Jitter Hand Tracking System for Improving Typing Efficiency in a Virtual Reality Workspace
Open Access
- 8 January 2025
- journal article
- research article
- Published by MDPI AG in Multimodal Technologies and Interaction
- Vol. 9 (1) , 4
Abstract
Virtual reality technology promises to transform immersive experiences across various applications, particularly within office environments. Despite its potential, the challenge of achieving efficient text entry in virtual reality persists. This study addresses this obstacle by introducing a novel machine learning-based solution, namely, the two-stream long short-term memory typing method, to enhance text entry performance in virtual reality. The two-stream long short-term memory method utilizes the back-of-the-hand image, employing a long short-term memory network and a Kalman filter to enhance hand position tracking accuracy and minimize jitter. Through statistical analysis of the data collected in the experiment and questionnaire results, we confirmed the effectiveness of the proposed method. In addition, we conducted an extra experiment to explore the differences in users’ typing behavior between regular typing and virtual reality-based typing. This additional experiment provides valuable insights into how users adapt their typing behavior in different environments. These findings represent a significant step in advancing text entry within virtual reality, setting the stage for immersive work experiences in office environments and beyond.Keywords
All Related Versions
This publication has 31 references indexed in Scilit:
- Handwriting for Efficient Text Entry in Industrial VR Applications: Influence of Board Orientation and Sensory Feedback on PerformanceIEEE Transactions on Visualization and Computer Graphics, 2023
- Work from home - A new virtual realityCurrent Psychology, 2022
- Text Input in Virtual Reality: A Preliminary Evaluation of the Drum-Like VR KeyboardTechnologies, 2019
- 11K Hands: Gender recognition and biometric identification using a large dataset of hand imagesMultimedia Tools and Applications, 2019
- Immersive Virtual Reality (IVR) in Higher Education: Development and Implementation2019
- Increasing student engagement through virtual interactions: How?Virtual Reality, 2018
- Metaphoric Hand Gestures for Orientation-Aware VR Object Manipulation With an Egocentric ViewpointIEEE Transactions on Human-Machine Systems, 2016
- On Continuous User Authentication via Typing BehaviorIEEE Transactions on Image Processing, 2014
- Optical flow-motion history image (OF-MHI) for action recognitionSignal, Image and Video Processing, 2014
- The recognition of human movement using temporal templatesIEEE Transactions on Pattern Analysis and Machine Intelligence, 2001