Robust Hand Gesture Input Using Computer Vision, Inertial Measurement Unit (IMU) and Flex Sensors
Authors:
- 1 May 2018
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 95-99
Abstract
Capturing the hand gesture is useful in many virtual reality applications like video games and surgery training for medical students. In this project, we have designed and built a hand tracking glove that is able to track the pose of the hand and the motion of the five fingers. We have employed sensing data from three different kinds of sensors, which includes a camera, an inertial measurement unit (IMU) and flex sensors. The ArUco marker is attached to the back of the glove to obtain the pose information of the hand from the camera. The Kalman filter is applied to stabilize the pose acquired. An IMU is adopted to increase the sampling rate up to 100Hz. Our system uses a sensor fusion scheme. Even if the ArUco marker is occluded temporarily, the pose of the glove can still be obtained. We also make use of the flex sensor to track the finger motion. In our experiment, it is shown that the motion of the hand and fingers can be obtained correctly. A virtual hand model in the computer moves simultaneously with the human hand in the real space.Keywords
This publication has 12 references indexed in Scilit:
- Flex2017
- A Two-Axis Goniometric Sensor for Tracking Finger MotionSensors, 2017
- ARMatron — A wearable gesture recognition glove: For control of robotic devices in disaster management and human Rehabilitation2016
- Robust Hand Motion Tracking through Data Fusion of 5DT Data Glove and Nimble VR Kinect Camera MeasurementsSensors, 2015
- Tracking 3-D motion from straight lines with trifocal tensorsMultimedia Systems, 2014
- Real-Time Hand Gesture Recognition Using Finger SegmentationThe Scientific World Journal, 2014
- Automatic generation and detection of highly reliable fiducial markers under occlusionPattern Recognition, 2014
- Robust hand gesture recognition with kinect sensor2011
- Fusion of IMU and Vision for Absolute Scale Estimation in Monocular SLAMJournal of Intelligent & Robotic Systems, 2010
- A survey of glove-based inputIEEE Computer Graphics and Applications, 1994