Human Multi-Activities Classification Using mmWave Radar: Feature Fusion in Time-Domain and PCANet
Open Access
Abstract
This study introduces an innovative approach by incorporating statistical offset features, range profiles, time–frequency analyses, and azimuth–range–time characteristics to effectively identify various human daily activities. Our technique utilizes nine feature vectors consisting of six statistical offset features and three principal component analysis network (PCANet) fusion attributes. These statistical offset features are derived from combined elevation and azimuth data, considering their spatial angle relationships. The fusion attributes are generated through concurrent 1D networks using CNN-BiLSTM. The process begins with the temporal fusion of 3D range–azimuth–time data, followed by PCANet integration. Subsequently, a conventional classification model is employed to categorize a range of actions. Our methodology was tested with 21,000 samples across fourteen categories of human daily activities, demonstrating the effectiveness of our proposed solution. The experimental outcomes highlight the superior robustness of our method, particularly when using the Margenau–Hill Spectrogram for time–frequency analysis. When employing a random forest classifier, our approach outperformed other classifiers in terms of classification efficacy, achieving an average sensitivity, precision, F1, specificity, and accuracy of 98.25%, 98.25%, 98.25%, 99.87%, and 99.75%, respectively.Keywords
Funding Information
- EPSRC IAA OSVMNC (EP/X5257161/1)
This publication has 48 references indexed in Scilit:
- Millimeter-Wave Radar-Based Elderly Fall Detection Fed by One-Dimensional Point Cloud and DopplerIEEE Access, 2023
- RF-Sensing: A New Way to Observe SurroundingsIEEE Access, 2022
- Scattering Centers to Point Clouds: A Review of mmWave Radars for Non-Radar-EngineersIEEE Access, 2022
- A Novel CNN-based Bi-LSTM parallel model with attention mechanism for human activity recognition with noisy dataScientific Reports, 2022
- Feature extraction and classification of load dynamic characteristics based on lifting wavelet packet transform in power system load modelingInternational Journal of Electrical Power & Energy Systems, 2014
- Measuring Skewness: A Forgotten Statistic?Journal of Statistics Education, 2011
- Mean, Median, and Skew: Correcting a Textbook RuleJournal of Statistics Education, 2005
- Time-varying spectral estimation using the instantaneous power spectrum (IPS)IEEE Transactions on Acoustics, Speech, and Signal Processing, 1990
- The Meaning of Kurtosis: Darlington ReexaminedThe American Statistician, 1986
- A Simple Approximation for Unbiased Estimation of the Standard DeviationThe American Statistician, 1971