Continuous Human Activity Classification From FMCW Radar With Bi-LSTM Networks
Top Cited Papers
Open Access
- 1 July 2020
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 20 (22) , 13607-13619
Abstract
Recognition of human movements with radar for ambient activity monitoring is a developed area of research that yet presents outstanding challenges to address. In real environments, activities and movements are performed with seamless motion, with continuous transitions between activities of different duration and a large range of dynamic motions, compared with discrete activities of fixed-time lengths which are typically analysed in the literature. This paper proposes a novel approach based on recurrent LSTM and Bi-LSTM network architectures for continuous activity monitoring and classification. This approach uses radar data in the form of a continuous temporal sequence of micro-Doppler or range-time information, differently from from other conventional approaches based on convolutional networks that interpret the radar data as images. Experimental radar data involving 15 participants and different sequences of 6 actions are used to validate the proposed approach. It is demonstrated that using the Dopplerdomain data together with the Bi-LSTM network and an optimal learning rate can achieve over 90% mean accuracy, whereas range-domain data only achieved approximately 76%. The details of the network architectures, insights in their behaviour as a function of key hyper-parameters such as the learning rate, and a discussion on their performance across are provided in the paper.Keywords
Funding Information
- U.K. EPSRC (EP/R041679/1)
This publication has 44 references indexed in Scilit:
- Radar Signal Processing for Elderly Fall Detection: The future for in-home monitoringIEEE Signal Processing Magazine, 2016
- Using bidirectional lstm recurrent neural networks to learn high-level abstractions of sequential features for automated scoring of non-native spontaneous speech2015
- Human Detection and Activity Classification Based on Micro-Doppler Signatures Using Deep Convolutional Neural NetworksIEEE Geoscience and Remote Sensing Letters, 2015
- UTD-MHAD: A multimodal dataset for human action recognition utilizing a depth camera and a wearable inertial sensor2015
- Deep learningNature, 2015
- Texture-Based Automatic Separation of Echoes from Distributed Moving Targets in UWB Radar SignalsIEEE Transactions on Geoscience and Remote Sensing, 2014
- Speech recognition with deep recurrent neural networks2013
- Micro-doppler effect in radar: phenomenon, model, and simulation studyIEEE Transactions on Aerospace and Electronic Systems, 2006
- Framewise phoneme classification with bidirectional LSTM and other neural network architecturesNeural Networks, 2005
- Long Short-Term MemoryNeural Computation, 1997