Multimodal data-based human motion intention prediction using adaptive hybrid deep learning network for movement challenged person
Open Access
- 24 December 2024
- journal article
- research article
- Published by Springer Nature in Scientific Reports
- Vol. 14 (1) , 1-27
Abstract
Recently, social demands for a good quality of life have increased among the elderly and disabled people. So, biomedical engineers and robotic researchers aimed to fuse these techniques in a novel rehabilitation system. Moreover, these models utilized the biomedical signals acquired from the human body's particular organ, cells, or tissues. The human motion intention prediction mechanism plays an essential role in various applications, such as assistive and rehabilitation robots, that execute specific tasks among elders and physically impaired individuals. However, more complications are increased in the human–machine-based interaction techniques, creating more scope for personalized assistance for the human motion intention prediction system. Therefore, in this paper, an Adaptive Hybrid Network (AHN) is implemented for effective human motion intention prediction. Initially, multimodal data like electroencephalogram (EEG)/Electromyography (EMG) signals and sensor measures data are collected from the available data resource. The gathered EEG/EMG signals are then converted into spectrogram images and sent to AH-CNN-LSTM, which is the integration of an Adaptive Hybrid Convolution Neural Network (AH-CNN) with a Long Short-Term Memory (LSTM) network. Similarly, the data details of sensor measures are directly subjected to AH-CNN-Res-LSTM, which is the combination of Adaptive Hybrid CNN with Residual Network and LSTM (Res-LSTM) to get the predictive result. Further, to enhance the prediction, the parameters in both the AH-CNN-LSTM and AH-CNN-Res-LSTM techniques are optimized using the Improved Yellow Saddle Goatfish Algorithm (IYSGA). The efficiency of the implemented model is computed by conducting the comparison experiment of the proposed technique with other standard models. The performance outcome of the developed method outperformed the other traditional methods.Keywords
Funding Information
- King Salman Center for Disability Research (KSRG-2023-451)
This publication has 55 references indexed in Scilit:
- Methods to Assess Energy Expenditure of Resistance Exercise: A Systematic Scoping ReviewSports Medicine, 2024
- Class imbalance in multi-resident activity recognition: an evaluative study on explainability of deep learning approachesUniversal Access in the Information Society, 2024
- FedHIP: Federated learning for privacy-preserving human intention prediction in human-robot collaborative assembly tasksAdvanced Engineering Informatics, 2024
- The role of artificial intelligence in electrodiagnostic and neuromuscular medicine:Currentstate and future directionsMuscle & Nerve, 2023
- Neural Network-Based Human Motion Predictor and SmootherSN Computer Science, 2023
- sEMG-Based Lower Limb Motion Prediction Using CNN-LSTM with Improved PCA Optimization AlgorithmJournal of Bionic Engineering, 2022
- A self-adaptive monarch butterfly optimization (MBO) algorithm based improved deep forest neural network model for detecting and classifying brain stroke lesionsResearch on Biomedical Engineering, 2022
- A review of the key technologies for sEMG-based human-robot interaction systemsBiomedical Signal Processing and Control, 2020
- A review of computational approaches for evaluation of rehabilitation exercisesComputers in Biology and Medicine, 2020
- A novel bio-inspired optimization model based on Yellow Saddle Goatfish behaviorBioSystems, 2018