Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors
Authors:
Open Access
- 8 February 2009
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 401-406
Abstract
This paper describes a novel hand gesture recognition system that utilizes both multi-channel surface electromyogram (EMG) sensors and 3D accelerometer (ACC) to realize user-friendly interaction between human and computers. Signal segments of meaningful gestures are determined from the continuous EMG signal inputs. Multi-stream Hidden Markov Models consisting of EMG and ACC streams are utilized as decision fusion method to recognize hand gestures. This paper also presents a virtual Rubik's Cube game that is controlled by the hand gestures and is used for evaluating the performance of our hand gesture recognition system. For a set of 18 kinds of gestures, each trained with 10 repetitions, the average recognition accuracy was about 91.7% in real application. The proposed method facilitates intelligent and natural control based on gesture interaction.Keywords
This publication has 7 references indexed in Scilit:
- EMG-based hand gesture recognition for realtime biosignal interfacing2008
- Myoelectric control systems—A surveyBiomedical Signal Processing and Control, 2007
- Gesture Recognition: A SurveyIEEE Transactions on Systems, Man and Cybernetics, Part C (Applications and Reviews), 2007
- Toward subtle intimate interfaces for mobile devices using an EMG controller2005
- Enabling fast and effortless customisation in accelerometer based gesture interaction2004
- A stream-weight optimization method for audio-visual speech recognition using multi-stream HMMs2004
- A neural network approach to monitor motor activities2003