Zihe Zhao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zihe Zhao has a total of 49 co-authors. Here are the top co-authors by number of shared publications:
- Shuo Gao
Beihang University
8 shared publications - Yu Pan
Tsinghua University
5 shared publications - Chenyu Tang
University of Cambridge
4 shared publications - Hongbei Meng
School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing 100191, China
4 shared publications - Shengbo Wang
School of Instrumentation and Optoelectronic Engineering, Beihang University, Beijing, China
4 shared publications - Xuhang Chen
University of Cambridge
3 shared publications
Latest Publications
- 19 August 2026
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 64 (9) , 3639-3655
A study on eye movement trajectory classification for strabismus screening via integration of global dependencies and temporal dynamics
- 19 August 2026
- Published by Springer Nature in Medical & Biological Engineering & Computing
- Vol. 64 (9) , 3639-3655
A study on eye movement trajectory classification for strabismus screening via integration of global dependencies and temporal dynamics
- Top Cited PapersOpen Access
- 16 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 34 (15344320) , 1606-1615
A Gaze-Driven Robotic System for Post-Stroke Active Ankle Rehabilitation Training
Lower-limb rehabilitation benefits from an input channel that conveys intent cleanly while actuation remains predictable and safety-bounded. We present a clinic-friendly, binocular gaze-driven paradigm that maps quadrant fixations to discrete commands for a two-degree-of-freedom ankle robot (dorsiflexion/plantarflexion and internal/external axial rotation), while inversion/eversion can be left compliant or mechanically constrained as needed. Pupil centers from a near-infrared tracker are mapped to a unit-normalized screen plane using low-order regression with ArUco-guided homography and rapid affine correction. A conservative dwell/occupancy rule triggers jerk-limited trajectories executed under cascaded position–velocity–current control with software rate/torque limits and watchdog supervision. In 20 healthy adults (1,600 trials), selection accuracy reached 99.94% with a 157.6 ms median end-to-end delay (gaze onset to motor onset). A head-tremor stress test produced no wrong-quadrant decisions and withheld decisions at the highest severity when the occupancy criterion was not met. Under passive drives, tracking was sub-degree (RMSE ≤0.224°) with smooth profiles and torques within software limits. Human factors outcomes were favorable, including a pilot post-stroke cohort, with high usability, low workload, and minimal visual fatigue (ΔVAS 0.14/0.21). These results support gaze as a practical, hands-free primary control channel for seated ankle training in clinical workflows.
- 16 March 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 34 (15344320) , 1606-1615
Top Cited PapersOpen AccessA Gaze-Driven Robotic System for Post-Stroke Active Ankle Rehabilitation Training
Lower-limb rehabilitation benefits from an input channel that conveys intent cleanly while actuation remains predictable and safety-bounded. We present a clinic-friendly, binocular gaze-driven paradigm that maps quadrant fixations to discrete commands for a two-degree-of-freedom ankle robot (dorsiflexion/plantarflexion and internal/external axial rotation), while inversion/eversion can be left compliant or mechanically constrained as needed. Pupil centers from a near-infrared tracker are mapped to a unit-normalized screen plane using low-order regression with ArUco-guided homography and rapid affine correction. A conservative dwell/occupancy rule triggers jerk-limited trajectories executed under cascaded position–velocity–current control with software rate/torque limits and watchdog supervision. In 20 healthy adults (1,600 trials), selection accuracy reached 99.94% with a 157.6 ms median end-to-end delay (gaze onset to motor onset). A head-tremor stress test produced no wrong-quadrant decisions and withheld decisions at the highest severity when the occupancy criterion was not met. Under passive drives, tracking was sub-degree (RMSE ≤0.224°) with smooth profiles and torques within software limits. Human factors outcomes were favorable, including a pilot post-stroke cohort, with high usability, low workload, and minimal visual fatigue (ΔVAS 0.14/0.21). These results support gaze as a practical, hands-free primary control channel for seated ankle training in clinical workflows.
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. PP (5) , 1-14
MHFS: Multimodal Haptic Feedback System for Enhanced Immersive Experience
Haptic feedback devices provide a sense of immersion that makes them play a key role in the domain of human-environment interactivities, such as in telemedicine, teleoperation, and online education. However, widely used unimodal or limited-modal approaches, such as vibrotactile, electrotactile, force-feedback, thermal, and emerging mid-air ultrasound/magnetorheological systems, are merely capable of simulating few virtual materials, exhibit a deficiency in fidelity, and necessitate substantial training expenditures. To address these limitations, we propose a multivirtual object recognition system based on multimodal haptic feedback and develop an evaluation and training scheme. The system is based on electrohaptic, vibrohaptic, and thermohaptic, acquires four haptic perception modalities, roughness, sharpness, hardness, and temperature, and simulates the haptic sensation of eight different materials. In experiments, the fidelity alignment of haptic feelings of real and virtual objects is 85.8%, and after averaged 2.8 trainings, the recognition accuracy reaches 100%. Our research not only improves the realism of haptic feedback but also significantly reduces the training cost, providing a more cost-effective and practical solution for user experience enhancement in virtual reality (VR) and meta-universe applications.
- 1 January 2026
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Computational Social Systems
- Vol. PP (5) , 1-14
MHFS: Multimodal Haptic Feedback System for Enhanced Immersive Experience
Haptic feedback devices provide a sense of immersion that makes them play a key role in the domain of human-environment interactivities, such as in telemedicine, teleoperation, and online education. However, widely used unimodal or limited-modal approaches, such as vibrotactile, electrotactile, force-feedback, thermal, and emerging mid-air ultrasound/magnetorheological systems, are merely capable of simulating few virtual materials, exhibit a deficiency in fidelity, and necessitate substantial training expenditures. To address these limitations, we propose a multivirtual object recognition system based on multimodal haptic feedback and develop an evaluation and training scheme. The system is based on electrohaptic, vibrohaptic, and thermohaptic, acquires four haptic perception modalities, roughness, sharpness, hardness, and temperature, and simulates the haptic sensation of eight different materials. In experiments, the fidelity alignment of haptic feelings of real and virtual objects is 85.8%, and after averaged 2.8 trainings, the recognition accuracy reaches 100%. Our research not only improves the realism of haptic feedback but also significantly reduces the training cost, providing a more cost-effective and practical solution for user experience enhancement in virtual reality (VR) and meta-universe applications.
- Open Access
- 25 December 2025
- Published by MDPI AG in Biosensors
- Vol. 16 (1) , 20
Active Rehabilitation Technologies for Post-Stroke Patients
Neuroplasticity-based active movement opens an avenue for functional recovery in post-stroke patients. Active rehabilitation techniques have attracted wide attention based on their abilities to enhance patient involvement, facilitate precise personalized intervention, and provide comprehensive treatment via cross-domain approaches. Emerging evidence suggests that active rehabilitation methods can respond to patients’ motor intentions in real-time and significantly increase motivation and engagement, leading to efficient utilization of critical recovery windows and better rehabilitation outcomes. In this review, we focus on the physiological basis of active rehabilitation, including mechanisms of neuroplasticity, and discuss recent advances in intent detection and feedback devices. We also examine treatment options for different stages of stroke recovery, providing a comprehensive reference for engineers to design optimized rehabilitation techniques and for clinicians to select appropriate rehabilitation protocols. These developments create new opportunities to improve the lives of stroke patients and offer greater hope for their recovery.
- 25 December 2025
- Published by MDPI AG in Biosensors
- Vol. 16 (1) , 20
Open AccessActive Rehabilitation Technologies for Post-Stroke Patients
Neuroplasticity-based active movement opens an avenue for functional recovery in post-stroke patients. Active rehabilitation techniques have attracted wide attention based on their abilities to enhance patient involvement, facilitate precise personalized intervention, and provide comprehensive treatment via cross-domain approaches. Emerging evidence suggests that active rehabilitation methods can respond to patients’ motor intentions in real-time and significantly increase motivation and engagement, leading to efficient utilization of critical recovery windows and better rehabilitation outcomes. In this review, we focus on the physiological basis of active rehabilitation, including mechanisms of neuroplasticity, and discuss recent advances in intent detection and feedback devices. We also examine treatment options for different stages of stroke recovery, providing a comprehensive reference for engineers to design optimized rehabilitation techniques and for clinicians to select appropriate rehabilitation protocols. These developments create new opportunities to improve the lives of stroke patients and offer greater hope for their recovery.
- Open Access
- 17 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 34 (15344320) , 300-312
An AI-Driven Multimodal Smart Home Platform for Continuous Monitoring and Assistance in Post-Stroke Motor Impairment
At-home rehabilitation for post-stroke patients presents significant challenges, as continuous, personalized care is often limited outside clinical settings. Moreover, the lack of integrated solutions capable of simultaneously monitoring motor recovery and providing intelligent assistance in home environments hampers rehabilitation outcomes. Here, we present a multimodal smart home platform designed for continuous, at-home rehabilitation of post-stroke patients, integrating wearable sensing, ambient monitoring, and adaptive automation. A plantar pressure insole equipped with a machine learning pipeline classifies users into motor recovery stages with up to 94% accuracy, enabling quantitative tracking of walking patterns during daily activities. An optional head-mounted eye-tracking module, together with ambient sensors such as cameras and microphones, supports seamless hands-free control of household devices with an average latency under 1 s with consistent operation. These data streams are fused locally via a hierarchical Internet of Things (IoT) architecture, ensuring low latency and data privacy. An embedded large language model (LLM) agent, Auto-Care, continuously interprets multimodal data to provide real-time interventions—issuing personalized reminders, adjusting environmental conditions, and notifying caregivers. Implemented in a post-stroke context, this integrated smart home platform increased mean user satisfaction from $3.9~\pm ~0.8$ in conventional home environments to $8.4~\pm ~0.6$ with the full system (n = 20). Beyond stroke, the system offers a scalable, patient-centered framework with potential for long-term use in broader neurorehabilitation and aging-in-place applications.
- 17 December 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Neural Systems and Rehabilitation Engineering
- Vol. 34 (15344320) , 300-312
Open AccessAn AI-Driven Multimodal Smart Home Platform for Continuous Monitoring and Assistance in Post-Stroke Motor Impairment
At-home rehabilitation for post-stroke patients presents significant challenges, as continuous, personalized care is often limited outside clinical settings. Moreover, the lack of integrated solutions capable of simultaneously monitoring motor recovery and providing intelligent assistance in home environments hampers rehabilitation outcomes. Here, we present a multimodal smart home platform designed for continuous, at-home rehabilitation of post-stroke patients, integrating wearable sensing, ambient monitoring, and adaptive automation. A plantar pressure insole equipped with a machine learning pipeline classifies users into motor recovery stages with up to 94% accuracy, enabling quantitative tracking of walking patterns during daily activities. An optional head-mounted eye-tracking module, together with ambient sensors such as cameras and microphones, supports seamless hands-free control of household devices with an average latency under 1 s with consistent operation. These data streams are fused locally via a hierarchical Internet of Things (IoT) architecture, ensuring low latency and data privacy. An embedded large language model (LLM) agent, Auto-Care, continuously interprets multimodal data to provide real-time interventions—issuing personalized reminders, adjusting environmental conditions, and notifying caregivers. Implemented in a post-stroke context, this integrated smart home platform increased mean user satisfaction from $3.9~\pm ~0.8$ in conventional home environments to $8.4~\pm ~0.6$ with the full system (n = 20). Beyond stroke, the system offers a scalable, patient-centered framework with potential for long-term use in broader neurorehabilitation and aging-in-place applications.
- 30 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Consumer Electronics Magazine
- Vol. 15 (2) , 31-46
Automated Strabismus Screening Based on a Wearable Eye Tracker
With the global market for ophthalmic screening devices projected to reach ${\$}$US11 billion by 2030, the development of accessible screening solutions presents substantial socioeconomic value. The key to the application of ophthalmic screening in consumer electronics lies in achieving rapid, accurate, user-friendly, and cost-effective large-scale screening. To address these requirements, this article presents a wearable strabismus screening device that utilizes eye-tracking technology. The screening device continuously captures near-infrared eye-movement images and employs image processing techniques to extract multidimensional eye-movement features based on pupil movements. Subsequently, a machine learning model is utilized to perform supervised classification and analyze the medical correlation of these features, providing a statistical foundation for clinical research into the etiology of strabismus. The method achieves a screening accuracy of 97.5% for 80 subjects (39 patients) and a 100% detection rate for strabismus patients. This product yields a portable, home-based screening solution with significant medical value and commercial potential.
- 30 June 2025
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Consumer Electronics Magazine
- Vol. 15 (2) , 31-46
Automated Strabismus Screening Based on a Wearable Eye Tracker
With the global market for ophthalmic screening devices projected to reach ${\$}$US11 billion by 2030, the development of accessible screening solutions presents substantial socioeconomic value. The key to the application of ophthalmic screening in consumer electronics lies in achieving rapid, accurate, user-friendly, and cost-effective large-scale screening. To address these requirements, this article presents a wearable strabismus screening device that utilizes eye-tracking technology. The screening device continuously captures near-infrared eye-movement images and employs image processing techniques to extract multidimensional eye-movement features based on pupil movements. Subsequently, a machine learning model is utilized to perform supervised classification and analyze the medical correlation of these features, providing a statistical foundation for clinical research into the etiology of strabismus. The method achieves a screening accuracy of 97.5% for 80 subjects (39 patients) and a 100% detection rate for strabismus patients. This product yields a portable, home-based screening solution with significant medical value and commercial potential.
- Open Access
Quantitative Analysis of Dual-Task Rehabilitation
BACKGROUND: Dual-task impairment severely limits functional recovery post-stroke. This diagnostic accuracy study aimed to develop an eye-tracking-based system for objectively quantifying ankle-cognitive integration deficits in stroke survivors. METHODS: This diagnostic accuracy study was conducted from January 2022 to October 2023 at Tsinghua Changgung Hospital in Beijing. A total of 20 healthy adults (mean age 53.15±6.26 years) participated in the study. In addition, 30 patients with a history of stroke (mean age 64.13±8.16 years, 8 females, disease duration 9.12±6.60 weeks) participated in a standardised dual-task evaluation. The novel system utilised 17 parameters, encompassing ankle kinematics (range of motion, velocity) and eye tracking (gaze duration, sweep latency), which were measured simultaneously during the cognitive motor task. Reliability was assessed by intragroup correlation coefficients (ICC), while criterion validity was assessed using 12 clinical evaluation metrics, including Spearman correlation with Montreal Cognitive Assessment (MOCA) scores and dual-task cost (DTC) percentages. RESULTS: The system demonstrated that 88.2% of the evaluation parameters exhibited high consistency, with 55.8% showing a moderate correlation with clinical benchmark scales (p<0.05). Notably, MOCA, DTC%, and TUG-subtraction task duration were identified as key indicators of dual-task ability (P<0.05), while the Self-Rating Anxiety Scale showed lower sensitivity. Furthermore, ankle motion parameters exhibited a strong correlation with balance and fall risk (P<0.05), effectively serving as predictors of motor function recovery and fall risk in stroke patients. CONCLUSIONS: This multimodal system reliably quantifies post-stroke dual-task deficits, with ankle kinematics and eye-tracking metrics serving as sensitive biomarkers for balance recovery and fall risk stratification. Findings advocate integrating objective dual-task metrics into neurorehabilitation protocols to optimize functional outcomes. (ChiCTR2300067640; URL: https://www.chictr.org.cn/showproj.html?proj=188211 ).
Open AccessQuantitative Analysis of Dual-Task Rehabilitation
BACKGROUND: Dual-task impairment severely limits functional recovery post-stroke. This diagnostic accuracy study aimed to develop an eye-tracking-based system for objectively quantifying ankle-cognitive integration deficits in stroke survivors. METHODS: This diagnostic accuracy study was conducted from January 2022 to October 2023 at Tsinghua Changgung Hospital in Beijing. A total of 20 healthy adults (mean age 53.15±6.26 years) participated in the study. In addition, 30 patients with a history of stroke (mean age 64.13±8.16 years, 8 females, disease duration 9.12±6.60 weeks) participated in a standardised dual-task evaluation. The novel system utilised 17 parameters, encompassing ankle kinematics (range of motion, velocity) and eye tracking (gaze duration, sweep latency), which were measured simultaneously during the cognitive motor task. Reliability was assessed by intragroup correlation coefficients (ICC), while criterion validity was assessed using 12 clinical evaluation metrics, including Spearman correlation with Montreal Cognitive Assessment (MOCA) scores and dual-task cost (DTC) percentages. RESULTS: The system demonstrated that 88.2% of the evaluation parameters exhibited high consistency, with 55.8% showing a moderate correlation with clinical benchmark scales (p<0.05). Notably, MOCA, DTC%, and TUG-subtraction task duration were identified as key indicators of dual-task ability (P<0.05), while the Self-Rating Anxiety Scale showed lower sensitivity. Furthermore, ankle motion parameters exhibited a strong correlation with balance and fall risk (P<0.05), effectively serving as predictors of motor function recovery and fall risk in stroke patients. CONCLUSIONS: This multimodal system reliably quantifies post-stroke dual-task deficits, with ankle kinematics and eye-tracking metrics serving as sensitive biomarkers for balance recovery and fall risk stratification. Findings advocate integrating objective dual-task metrics into neurorehabilitation protocols to optimize functional outcomes. (ChiCTR2300067640; URL: https://www.chictr.org.cn/showproj.html?proj=188211 ).
- Open Access
- 14 February 2025
- Published by MDPI AG in Biosensors
- Vol. 15 (2) , 110
High-Accuracy Intermittent Strabismus Screening via Wearable Eye-Tracking and AI-Enhanced Ocular Feature Analysis
An effective and highly accurate strabismus screening method is expected to identify potential patients and provide timely treatment to prevent further deterioration, such as amblyopia and even permanent vision loss. To satisfy this need, this work showcases a novel strabismus screening method based on a wearable eye-tracking device combined with an artificial intelligence (AI) algorithm. To identify the minor and occasional inconsistencies in strabismus patients during the binocular coordination process, which are usually seen in early-stage patients and rarely recognized in current studies, the system captures temporally and spatially continuous high-definition infrared images of the eye during wide-angle continuous motion, and is effective in inducing intermittent strabismus. Based on the collected eye motion information, 16 features of the oculomotor process with strong physiological interpretations, which help biomedical staff understand and evaluate results generated later, are calculated through the introduction of pupil-canthus vectors. These features can be normalized, and reflect individual differences. After these features are processed by the random forest (RF) algorithm, this method experimentally yields 97.1% accuracy in strabismus detection in 70 people under diverse indoor testing conditions, validating the high accuracy and robustness of the method, and implying that the method has strong potential to support widespread and highly accurate strabismus screening.
- 14 February 2025
- Published by MDPI AG in Biosensors
- Vol. 15 (2) , 110
Open AccessHigh-Accuracy Intermittent Strabismus Screening via Wearable Eye-Tracking and AI-Enhanced Ocular Feature Analysis
An effective and highly accurate strabismus screening method is expected to identify potential patients and provide timely treatment to prevent further deterioration, such as amblyopia and even permanent vision loss. To satisfy this need, this work showcases a novel strabismus screening method based on a wearable eye-tracking device combined with an artificial intelligence (AI) algorithm. To identify the minor and occasional inconsistencies in strabismus patients during the binocular coordination process, which are usually seen in early-stage patients and rarely recognized in current studies, the system captures temporally and spatially continuous high-definition infrared images of the eye during wide-angle continuous motion, and is effective in inducing intermittent strabismus. Based on the collected eye motion information, 16 features of the oculomotor process with strong physiological interpretations, which help biomedical staff understand and evaluate results generated later, are calculated through the introduction of pupil-canthus vectors. These features can be normalized, and reflect individual differences. After these features are processed by the random forest (RF) algorithm, this method experimentally yields 97.1% accuracy in strabismus detection in 70 people under diverse indoor testing conditions, validating the high accuracy and robustness of the method, and implying that the method has strong potential to support widespread and highly accurate strabismus screening.