Action recognition using micro-Doppler signatures and a recurrent neural network
Authors:
- 1 March 2017
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1-5
Abstract
This paper explores the long short-term memory (LSTM) recurrent neural network for human action recognition from micro-Doppler signatures. The recurrent neural network model is evaluated using the Johns Hopkins MultiModal Action (JHUMMA) dataset. In testing we use only the active acoustic micro-Doppler signatures. We compare classification performed using hidden Markov model (HMM) systems trained on both micro-Doppler sensor and Kinect data with LSTM classification trained only on the micro-Doppler signatures. For HMM systems we evaluate the performance of product of expert based systems and systems trained on concatenated sensor data. By testing with leave one user out (LOUO) cross-validation we verify the ability of these systems to generalize to new users. We find that LSTM systems trained only on micro-Doppler signatures outperform the other models evaluated.Keywords
This publication has 8 references indexed in Scilit:
- A multimodal-corpus data collection system for cognitive acoustic scene analysis2011
- Theano: A CPU and GPU Math Compiler in PythonProceedings of the Python in Science Conference, 2010
- Acoustic micro-Doppler radar for human gait imagingThe Journal of the Acoustical Society of America, 2007
- 3D Imaging Camera for Gaming Application2007
- Micro-doppler effect in radar: phenomenon, model, and simulation studyIEEE Transactions on Aerospace and Electronic Systems, 2006
- Learning to Forget: Continual Prediction with LSTMNeural Computation, 2000
- Long Short-Term MemoryNeural Computation, 1997
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989