Bailin He
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Bailin He has a total of 12 co-authors. Here are the top co-authors by number of shared publications:
- Can Wang
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
4 shared publications - Xinyu Wu
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
4 shared publications - Jiaqing Liu
Guangdong Provincial Key Laboratory of Robotics and Intelligent System, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
2 shared publications - Pengbo Li
Guangdong Provincial Key Laboratory of Robotics and Intelligent System, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Beijing, China
2 shared publications - Hao Wang
Leiden University
1 shared publication - Mengyao Li
Qiyuan Laboratory, Beijing, China
1 shared publication
Latest Publications
- 4 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 20 (2) , 901-908
Prediction of Contralateral Lower-Limb Joint Angles Using Vibroarthrography and Surface Electromyography Signals in Time-Series Network
Multisource biosignals are being increasingly used in human–machine interaction applications. In particular, a critical problem in exoskeleton-assisted rehabilitation for patients with hemiplegia is the generation of rhythmic and symmetrical locomotion. To support lower limb rehabilitation, we propose a model for predicting contralateral joint angles using multisource biosignals. First, a vibroarthrography (VAG) sensor is attached to the affected leg, and surface electromyography sensors are attached to the sound leg. The corresponding signals are used to estimate the hip, knee, and ankle joint angles of the affected leg. Second, an algorithm based on a temporal convolution network (TCN) is introduced to predict the contralateral lower-limb joint angles during human locomotion. The TCN is compared with a long short-term memory (LSTM) network and a convolutional neural network. Experiments were conducted by 10 healthy participants. The results of the proposed model were compared with measurements from encoders in three joints mounted on an exoskeleton to verify the applicability of the proposed model. In addition, by using the outputs of a motion capture system as the ground truth, the experimental results validated the model prediction performance. The prediction root mean square error (RMSE) of the TCN was 52%–70% lower than that of the LSTM network and CNN at different paces. The prediction RMSE using VAG was 20%–24% lower than that without using VAG. Note to Practitioners—We propose a model for predicting the contralateral lower-limb joint angles of an exoskeleton. The model uses measurements from multiple biosignal sensors to support exoskeleton-assisted hemiplegia rehabilitation. A sensing system based on acoustic signals and bioelectric signals is developed to improve the joint angle prediction in the affected leg of patients with hemiplegia. A temporal convolution network is implemented to estimate joint angles, and training considering the root mean square error and Pearson correlation coefficient as evaluation indicators is performed. Unlike similar methods that include no sensory feedback from the affected leg, the proposed method incorporates VAG signals from the affected leg and sEMG signals from the sound leg to handle different degrees of hemiplegia and support the generation of rhythmic and symmetrical locomotion for gait rehabilitation using an exoskeleton.
- 4 July 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Automation Science and Engineering
- Vol. 20 (2) , 901-908
Prediction of Contralateral Lower-Limb Joint Angles Using Vibroarthrography and Surface Electromyography Signals in Time-Series Network
Multisource biosignals are being increasingly used in human–machine interaction applications. In particular, a critical problem in exoskeleton-assisted rehabilitation for patients with hemiplegia is the generation of rhythmic and symmetrical locomotion. To support lower limb rehabilitation, we propose a model for predicting contralateral joint angles using multisource biosignals. First, a vibroarthrography (VAG) sensor is attached to the affected leg, and surface electromyography sensors are attached to the sound leg. The corresponding signals are used to estimate the hip, knee, and ankle joint angles of the affected leg. Second, an algorithm based on a temporal convolution network (TCN) is introduced to predict the contralateral lower-limb joint angles during human locomotion. The TCN is compared with a long short-term memory (LSTM) network and a convolutional neural network. Experiments were conducted by 10 healthy participants. The results of the proposed model were compared with measurements from encoders in three joints mounted on an exoskeleton to verify the applicability of the proposed model. In addition, by using the outputs of a motion capture system as the ground truth, the experimental results validated the model prediction performance. The prediction root mean square error (RMSE) of the TCN was 52%–70% lower than that of the LSTM network and CNN at different paces. The prediction RMSE using VAG was 20%–24% lower than that without using VAG. Note to Practitioners—We propose a model for predicting the contralateral lower-limb joint angles of an exoskeleton. The model uses measurements from multiple biosignal sensors to support exoskeleton-assisted hemiplegia rehabilitation. A sensing system based on acoustic signals and bioelectric signals is developed to improve the joint angle prediction in the affected leg of patients with hemiplegia. A temporal convolution network is implemented to estimate joint angles, and training considering the root mean square error and Pearson correlation coefficient as evaluation indicators is performed. Unlike similar methods that include no sensory feedback from the affected leg, the proposed method incorporates VAG signals from the affected leg and sEMG signals from the sound leg to handle different degrees of hemiplegia and support the generation of rhythmic and symmetrical locomotion for gait rehabilitation using an exoskeleton.
- 23 June 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (3) , 7779-7785
A Novel Method for Detecting Misclassifications of the Locomotion Mode in Lower-Limb Exoskeleton Robot Control
Lower-limb exoskeleton robots can support hemiplegic patients’ affected limbs and assist in their rehabilitation. In order to set effective control strategies, it is necessary to obtain the user’s motion intention accurately and timeously. These requirements pose many challenges. The surface electromyography (sEMG) signal has long been used for detecting a person’s locomotion mode. However, most traditional myoelectric motion recognition methods need to collect multi-channel sEMG signals (more than eight) and use feature engineering to obtain the desired accuracy. Additionally, traditional methods make decisions when the recognition probability is still uncertain, resulting in misclassification during continuous recognition. In order to overcome these limitations, a dual-purpose autoencoder-guided temporal convolution network (DA-TCN) is proposed, which is used as a motion detection model for a lower-limb exoskeleton robot based on sEMG. In the proposed method, we first obtain four-channel sEMG signals without any feature engineering. Next, the DA-TCN is used to obtain the discriminative deep features of the sEMG signals. Compared with separable features from common TCNs, discriminative features assist in obtaining a more discriminative twins-loss. Finally, the classification result is redetermined by the decoder, based on the reconstruction of deep features, and misclassifications are rejected based on the value of the twins-loss. The performance of the proposed method was evaluated by obtaining data from seven volunteer subjects in seven locomotion modes. The proposed method was able to effectively detect misclassifications and significantly improved the stability of continuous recognition.
- 23 June 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Robotics and Automation Letters
- Vol. 7 (3) , 7779-7785
A Novel Method for Detecting Misclassifications of the Locomotion Mode in Lower-Limb Exoskeleton Robot Control
Lower-limb exoskeleton robots can support hemiplegic patients’ affected limbs and assist in their rehabilitation. In order to set effective control strategies, it is necessary to obtain the user’s motion intention accurately and timeously. These requirements pose many challenges. The surface electromyography (sEMG) signal has long been used for detecting a person’s locomotion mode. However, most traditional myoelectric motion recognition methods need to collect multi-channel sEMG signals (more than eight) and use feature engineering to obtain the desired accuracy. Additionally, traditional methods make decisions when the recognition probability is still uncertain, resulting in misclassification during continuous recognition. In order to overcome these limitations, a dual-purpose autoencoder-guided temporal convolution network (DA-TCN) is proposed, which is used as a motion detection model for a lower-limb exoskeleton robot based on sEMG. In the proposed method, we first obtain four-channel sEMG signals without any feature engineering. Next, the DA-TCN is used to obtain the discriminative deep features of the sEMG signals. Compared with separable features from common TCNs, discriminative features assist in obtaining a more discriminative twins-loss. Finally, the classification result is redetermined by the decoder, based on the reconstruction of deep features, and misclassifications are rejected based on the value of the twins-loss. The performance of the proposed method was evaluated by obtaining data from seven volunteer subjects in seven locomotion modes. The proposed method was able to effectively detect misclassifications and significantly improved the stability of continuous recognition.
- 12 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Robotics and Bionics
- Vol. 4 (2) , 472-479
Metric Learning for Robust Gait Phase Recognition for a Lower Limb Exoskeleton Robot Based on sEMG
This study aims to develop a robust myoelectric control method for gait phase recognition in a lower-limb exoskeleton robot. In the proposed method, a metric learning-based temporal convolution network (ML-TCN) was utilized to extract discriminative features of the surface electromyography (sEMG) signals and recognize four gait phases: heel strike (HS), foot flat (FF), heel off (HO), and swing (SW). Vicon validated the effectiveness of the sEMG data-acquisition system. The proposed method acquires significantly more discriminative features than long short-term memory (LSTM) or common temporal convolutional network (TCN). The experimental results show that the proposed model has a higher prediction accuracy and stronger robustness against disturbances in complex terrain. Finally, under the complex terrain of level ground-ramp ascending-ramp descending walking, the proposed model’s accuracy of gait phase recognition is 96.22%, which is better than LSTM’s 91.20%. Noise disturbances of 10%, 20%, 30%, 40%, and 50% were added to the test set. Compared with LSTM, the resistance to disturbances of the proposed method increased by 8.15%, 8.79%, 9.67%, 10.6%, and 10.61%, respectively.
- 12 April 2022
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Medical Robotics and Bionics
- Vol. 4 (2) , 472-479
Metric Learning for Robust Gait Phase Recognition for a Lower Limb Exoskeleton Robot Based on sEMG
This study aims to develop a robust myoelectric control method for gait phase recognition in a lower-limb exoskeleton robot. In the proposed method, a metric learning-based temporal convolution network (ML-TCN) was utilized to extract discriminative features of the surface electromyography (sEMG) signals and recognize four gait phases: heel strike (HS), foot flat (FF), heel off (HO), and swing (SW). Vicon validated the effectiveness of the sEMG data-acquisition system. The proposed method acquires significantly more discriminative features than long short-term memory (LSTM) or common temporal convolutional network (TCN). The experimental results show that the proposed model has a higher prediction accuracy and stronger robustness against disturbances in complex terrain. Finally, under the complex terrain of level ground-ramp ascending-ramp descending walking, the proposed model’s accuracy of gait phase recognition is 96.22%, which is better than LSTM’s 91.20%. Noise disturbances of 10%, 20%, 30%, 40%, and 50% were added to the test set. Compared with LSTM, the resistance to disturbances of the proposed method increased by 8.15%, 8.79%, 9.67%, 10.6%, and 10.61%, respectively.
- 1 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 13, 1-6
A Method for Recognition of Dynamic Hand Gestures Based on Wrist Tendon Sounds
Hand gesture recognition are widely applied in game industry and rehabilitation engineering. Some recognition methods based on physiological data are attracting attention. In this paper, a novel method for dynamic hand gesture recognition based on sounds of wrist tendon is proposed. Bone conduction sensors which automatically filter the ambient noise is utilized to collect the wrist tendon sounds of three types of dynamic hand gestures. Continuous Wavelet Transform(CWT) is utilized extract the features of sounds and Support Vector Machine(SVM) is utilized to train the classifier model. Five healthy subjects participated the experiment and the average test accuracy of three classes achieves 92.33%. The proposed method provides an effective perspective for hand gesture recognition.
- 1 March 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 13, 1-6
A Method for Recognition of Dynamic Hand Gestures Based on Wrist Tendon Sounds
Hand gesture recognition are widely applied in game industry and rehabilitation engineering. Some recognition methods based on physiological data are attracting attention. In this paper, a novel method for dynamic hand gesture recognition based on sounds of wrist tendon is proposed. Bone conduction sensors which automatically filter the ambient noise is utilized to collect the wrist tendon sounds of three types of dynamic hand gestures. Continuous Wavelet Transform(CWT) is utilized extract the features of sounds and Support Vector Machine(SVM) is utilized to train the classifier model. Five healthy subjects participated the experiment and the average test accuracy of three classes achieves 92.33%. The proposed method provides an effective perspective for hand gesture recognition.