Hao Zhou
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Hao Zhou has a total of 44 co-authors. Here are the top co-authors by number of shared publications:
- Mahanth Gowda
Computer Science and Engineering, Pennsylvania State University, University Park, Pennsylvania, USA
7 shared publications - Taiting Lu
Pennsylvania State University, University Park, Pennsylvania, USA
5 shared publications - Runze Liu
Pennsylvania State University, University Park, Pennsylvania, USA
3 shared publications - Jie Xiong
Nanyang technological university, Singapore, Singapore
2 shared publications - Kenneth DeHaan
Department of ASL Studies, Gallaudet University, Washington, District of Columbia, USA
2 shared publications - Kuang Yuan
Carnegie Mellon University, Pittsburgh, USA
2 shared publications
Latest Publications
- Open Access
- 26 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 457-472
Exploring the Feasibility of Full-Body Muscle Activation Sensing with Insole Pressure Sensors
- 26 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 457-472
Open AccessExploring the Feasibility of Full-Body Muscle Activation Sensing with Insole Pressure Sensors
- Open Access
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-17
SignGlass: First-Person View Comprehensive and Generalizable ASL Translation Using Wearable Glass
- 27 September 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-17
Open AccessSignGlass: First-Person View Comprehensive and Generalizable ASL Translation Using Wearable Glass
- Open Access
- 23 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 691-692
Rethinking Inexpensive Wearables in the Era of AI: From Motion Analytics to Mobile Health
- 23 June 2025
- Published by Association for Computing Machinery (ACM)
- p. 691-692
Open AccessRethinking Inexpensive Wearables in the Era of AI: From Motion Analytics to Mobile Health
- Open Access
- 9 June 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (2) , 1-25
WindDancer: Understanding Acoustic Sensing under Ambient Airflow
Acoustic sensing has recently garnered significant interest for a wide range of applications ranging from motion tracking to health monitoring. However, prior works overlooked an important real-world factor affecting acoustic sensing systems---the instability of the propagation medium due to ambient airflow. Airflow introduces rapid and random fluctuations in the speed of sound, leading to performance degradation in acoustic sensing tasks. This paper presents WindDancer, the first comprehensive framework to understand how ambient airflow influences existing acoustic sensing systems, as well as provides solutions to enhance systems performance in the presence of airflow. Specifically, our work includes a mechanistic understanding of airflow interference, modeling of sound speed variations, and analysis of how several key real-world factors interact with airflow. Furthermore, we provide practical recommendations and signal processing solutions to improve the resilience of acoustic sensing systems for real-world deployment. We envision that WindDancer establishes a theoretical foundation for understanding the impact of airflow on acoustic sensing, and advances the reliability of acoustic sensing technologies for broader adoption.
- 9 June 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (2) , 1-25
Open AccessWindDancer: Understanding Acoustic Sensing under Ambient Airflow
Acoustic sensing has recently garnered significant interest for a wide range of applications ranging from motion tracking to health monitoring. However, prior works overlooked an important real-world factor affecting acoustic sensing systems---the instability of the propagation medium due to ambient airflow. Airflow introduces rapid and random fluctuations in the speed of sound, leading to performance degradation in acoustic sensing tasks. This paper presents WindDancer, the first comprehensive framework to understand how ambient airflow influences existing acoustic sensing systems, as well as provides solutions to enhance systems performance in the presence of airflow. Specifically, our work includes a mechanistic understanding of airflow interference, modeling of sound speed variations, and analysis of how several key real-world factors interact with airflow. Furthermore, we provide practical recommendations and signal processing solutions to improve the resilience of acoustic sensing systems for real-world deployment. We envision that WindDancer establishes a theoretical foundation for understanding the impact of airflow on acoustic sensing, and advances the reliability of acoustic sensing technologies for broader adoption.
- Open Access
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-21
BallistoBud: Heart Rate Variability Monitoring using Earbud Accelerometry for Stress Assessment
- 25 April 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-21
Open AccessBallistoBud: Heart Rate Variability Monitoring using Earbud Accelerometry for Stress Assessment
- Open Access
- 4 December 2024
- Published by Association for Computing Machinery (ACM)
- p. 1045-1059
Rethinking Orientation Estimation with Smartphone-equipped Ultra-wideband Chips
While localization has gained a tremendous amount of attention from both academia and industry, much less attention has been paid to equally important orientation estimation. Traditional orientation estimation systems relying on gyroscopes suffer from cumulative errors. In this paper, we propose UWBOrient, the first fine-grained orientation estimation system utilizing ultra-wideband (UWB) modules embedded in smartphones. The proposed system presents an alternative solution that is more accurate than gyroscope estimates and free of error accumulation. We propose to fuse UWB estimates with gyroscope estimates to address the challenge associated with UWB estimation alone and further improve the estimation accuracy. UWBOrient decreases the estimation error from the state-of-the-art 7.6° to 2.7° while maintaining a low latency (20 ms) and low energy consumption (40 mWh). Comprehensive experiments with both iPhone and Android smartphones demonstrate the effectiveness of the proposed system under various conditions including natural motion, dynamic multipath and NLoS. Two real-world applications, i.e., head orientation tracking and 3D reconstruction are employed to showcase the practicality of UWBOrient.
- 4 December 2024
- Published by Association for Computing Machinery (ACM)
- p. 1045-1059
Open AccessRethinking Orientation Estimation with Smartphone-equipped Ultra-wideband Chips
While localization has gained a tremendous amount of attention from both academia and industry, much less attention has been paid to equally important orientation estimation. Traditional orientation estimation systems relying on gyroscopes suffer from cumulative errors. In this paper, we propose UWBOrient, the first fine-grained orientation estimation system utilizing ultra-wideband (UWB) modules embedded in smartphones. The proposed system presents an alternative solution that is more accurate than gyroscope estimates and free of error accumulation. We propose to fuse UWB estimates with gyroscope estimates to address the challenge associated with UWB estimation alone and further improve the estimation accuracy. UWBOrient decreases the estimation error from the state-of-the-art 7.6° to 2.7° while maintaining a low latency (20 ms) and low energy consumption (40 mWh). Comprehensive experiments with both iPhone and Android smartphones demonstrate the effectiveness of the proposed system under various conditions including natural motion, dynamic multipath and NLoS. Two real-world applications, i.e., head orientation tracking and 3D reconstruction are employed to showcase the practicality of UWBOrient.
- Open Access
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-30
SmartDampener: An Open Source Platform for Sport Analytics in Tennis
In this paper, we introduce SmartDampener, an open-source tennis analytics platform that redefines the traditional understanding of vibration dampeners. Traditional vibration dampeners favored by both amateur and professional tennis players are utilized primarily to diminish vibration transmission and enhance racket stability. However, our platform uniquely merges wireless sensing technologies into a device that resembles a conventional vibration dampener, thereby offering a range of tennis performance metrics including ball speed, impact location, and stroke type. The design of SmartDampener adheres to the familiar form of this accessory, ensuring that (i) it is readily accepted by users and robust under real-play conditions such as ball-hitting, (ii) it has minimal impact on player performance, (iii) it is capable of providing a wide range of analytical insights, and (iv) it is extensible to other sports. Existing computer vision systems for tennis sensing such as Hawk-eye and PlaySight, rely on hardware that costs millions of US dollars to deploy with complex setup procedures and is susceptible to lighting environment. Wearable devices and other tennis sensing accessories, such as Zepp Tennis sensor and TennisEye, using intrusive mounting locations, hinder user experience and impede player performance. In contrast, SmartDampener, a low-cost and compact tennis sensing device, notable for its socially accepted, lightweight and scalable design, seamlessly melds into the form of a vibration dampener. SmartDampener exploits opportunities in SoC and form factor design of conventional dampeners to integrate the sensing units and micro-controllers on a two-layer flexible PCB, that is bent and enclosed inside a dampener case made of 3D printing TPU material, while maintaining the vibration dampening feature and further being enhanced by its extended battery life and the inclusion of wireless communication features. The overall cost is $9.42, with a dimension of 21.4 mm × 27.5 mm × 9.7 mm (W × L × H) and a weight of 6.1 g and 5.8 hours of battery life. In proof of SmartDampener's performance in tennis analytics, we present various tennis analytic applications that exploit the capability of SmartDampener in capturing the correlations across string vibration, and racket motion, including the estimation of ball speed with a median error of 3.59 mph, estimation of ball impact location with accuracy of 3.03 cm, and classification of six tennis strokes with accuracy of 96.75%. Finally, extensive usability studies with 15 tennis players indicate high levels of social acceptance of form factor design for the SmartDampener dampener in comparison with alternative form factors, as well as its capability of sensing and analyzing tennis stroke in an accurate and robust manner. We believe this platform will enable exciting applications in other sports like badminton, fitness tracking, and injury prevention.
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-30
Open AccessSmartDampener: An Open Source Platform for Sport Analytics in Tennis
In this paper, we introduce SmartDampener, an open-source tennis analytics platform that redefines the traditional understanding of vibration dampeners. Traditional vibration dampeners favored by both amateur and professional tennis players are utilized primarily to diminish vibration transmission and enhance racket stability. However, our platform uniquely merges wireless sensing technologies into a device that resembles a conventional vibration dampener, thereby offering a range of tennis performance metrics including ball speed, impact location, and stroke type. The design of SmartDampener adheres to the familiar form of this accessory, ensuring that (i) it is readily accepted by users and robust under real-play conditions such as ball-hitting, (ii) it has minimal impact on player performance, (iii) it is capable of providing a wide range of analytical insights, and (iv) it is extensible to other sports. Existing computer vision systems for tennis sensing such as Hawk-eye and PlaySight, rely on hardware that costs millions of US dollars to deploy with complex setup procedures and is susceptible to lighting environment. Wearable devices and other tennis sensing accessories, such as Zepp Tennis sensor and TennisEye, using intrusive mounting locations, hinder user experience and impede player performance. In contrast, SmartDampener, a low-cost and compact tennis sensing device, notable for its socially accepted, lightweight and scalable design, seamlessly melds into the form of a vibration dampener. SmartDampener exploits opportunities in SoC and form factor design of conventional dampeners to integrate the sensing units and micro-controllers on a two-layer flexible PCB, that is bent and enclosed inside a dampener case made of 3D printing TPU material, while maintaining the vibration dampening feature and further being enhanced by its extended battery life and the inclusion of wireless communication features. The overall cost is $9.42, with a dimension of 21.4 mm × 27.5 mm × 9.7 mm (W × L × H) and a weight of 6.1 g and 5.8 hours of battery life. In proof of SmartDampener's performance in tennis analytics, we present various tennis analytic applications that exploit the capability of SmartDampener in capturing the correlations across string vibration, and racket motion, including the estimation of ball speed with a median error of 3.59 mph, estimation of ball impact location with accuracy of 3.03 cm, and classification of six tennis strokes with accuracy of 96.75%. Finally, extensive usability studies with 15 tennis players indicate high levels of social acceptance of form factor design for the SmartDampener dampener in comparison with alternative form factors, as well as its capability of sensing and analyzing tennis stroke in an accurate and robust manner. We believe this platform will enable exciting applications in other sports like badminton, fitness tracking, and injury prevention.
- Open Access
- 16 December 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Internet of Things
- Vol. 5 (1) , 1-29
I Am an Earphone and I Can Hear My User’s Face: Facial Landmark Tracking Using Smart Earphones
This article presents EARFace , a system that shows the feasibility of tracking facial landmarks for 3D facial reconstruction using in-ear acoustic sensors embedded within smart earphones. This enables a number of applications in the areas of facial expression tracking, user interfaces, AR/VR applications, affective computing, and accessibility, among others. Although conventional vision-based solutions break down under poor lighting and occlusions, and also suffer from privacy concerns, earphone platforms are robust to ambient conditions while being privacy-preserving. In contrast to prior work on earable platforms that perform outer-ear sensing for facial motion tracking, EARFace shows the feasibility of completely in-ear sensing with a natural earphone form factor, thus enhancing the comfort levels of wearing. The core intuition exploited by EARFace is that the shape of the ear canal changes due to the movement of facial muscles during facial motion. EARFace tracks the changes in shape of the ear canal by measuring ultrasonic channel frequency response of the inner ear, ultimately resulting in tracking of the facial motion. A transformer-based machine learning model is designed to exploit spectral and temporal relationships in the ultrasonic channel frequency response data to predict the facial landmarks of the user with an accuracy of 1.83 mm. Using these predicted landmarks, a 3D graphical model of the face that replicates the precise facial motion of the user is then reconstructed. Domain adaptation is further performed by adapting the weights of layers using a group-wise and differential learning rate. This decreases the training overhead in EARFace . The transformer-based machine learning model runs on smart phone devices with a processing latency of 13 ms and an overall low power consumption profile. Finally, usability studies indicate higher levels of comforts of wearing EARFace ’s earphone platform in comparison with alternative form factors.
- 16 December 2023
- Published by Association for Computing Machinery (ACM) in ACM Transactions on Internet of Things
- Vol. 5 (1) , 1-29
Open AccessI Am an Earphone and I Can Hear My User’s Face: Facial Landmark Tracking Using Smart Earphones
This article presents EARFace , a system that shows the feasibility of tracking facial landmarks for 3D facial reconstruction using in-ear acoustic sensors embedded within smart earphones. This enables a number of applications in the areas of facial expression tracking, user interfaces, AR/VR applications, affective computing, and accessibility, among others. Although conventional vision-based solutions break down under poor lighting and occlusions, and also suffer from privacy concerns, earphone platforms are robust to ambient conditions while being privacy-preserving. In contrast to prior work on earable platforms that perform outer-ear sensing for facial motion tracking, EARFace shows the feasibility of completely in-ear sensing with a natural earphone form factor, thus enhancing the comfort levels of wearing. The core intuition exploited by EARFace is that the shape of the ear canal changes due to the movement of facial muscles during facial motion. EARFace tracks the changes in shape of the ear canal by measuring ultrasonic channel frequency response of the inner ear, ultimately resulting in tracking of the facial motion. A transformer-based machine learning model is designed to exploit spectral and temporal relationships in the ultrasonic channel frequency response data to predict the facial landmarks of the user with an accuracy of 1.83 mm. Using these predicted landmarks, a 3D graphical model of the face that replicates the precise facial motion of the user is then reconstructed. Domain adaptation is further performed by adapting the weights of layers using a group-wise and differential learning rate. This decreases the training overhead in EARFace . The transformer-based machine learning model runs on smart phone devices with a processing latency of 13 ms and an overall low power consumption profile. Finally, usability studies indicate higher levels of comforts of wearing EARFace ’s earphone platform in comparison with alternative form factors.
- Open Access
- 2 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-16
SignQuery: A Natural User Interface and Search Engine for Sign Languages with Wearable Sensors
- 2 October 2023
- Published by Association for Computing Machinery (ACM)
- p. 1-16
Open AccessSignQuery: A Natural User Interface and Search Engine for Sign Languages with Wearable Sensors
- 15 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1221-1225
Research on Automatic Obstacle Avoidance Path Planning of Overhead Transmission Line Inspection Robot
In order to improve the obstacle avoidance ability of inspection robots, an automatic obstacle avoidance path planning method for overhead transmission line inspection robots is proposed. Firstly, in order to improve the communication stability of the inspection robot and avoid the interference of the path signal, the wavelet packet transform is used to collect and filter the robot communication signal. Secondly, the path grid of the inspection robot is constructed, and the coordinate and grid are transformed. Finally, the ant colony algorithm is used to optimize the obstacle avoidance path of the inspection robot, and the path planning results of the inspection robot are obtained. Experimental results show that this method can avoid obstacles in both static and dynamic states, still has a high success rate of obstacle avoidance, and can complete obstacle avoidance path planning in a short time.
- 15 September 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- p. 1221-1225
Research on Automatic Obstacle Avoidance Path Planning of Overhead Transmission Line Inspection Robot
In order to improve the obstacle avoidance ability of inspection robots, an automatic obstacle avoidance path planning method for overhead transmission line inspection robots is proposed. Firstly, in order to improve the communication stability of the inspection robot and avoid the interference of the path signal, the wavelet packet transform is used to collect and filter the robot communication signal. Secondly, the path grid of the inspection robot is constructed, and the coordinate and grid are transformed. Finally, the ant colony algorithm is used to optimize the obstacle avoidance path of the inspection robot, and the path planning results of the inspection robot are obtained. Experimental results show that this method can avoid obstacles in both static and dynamic states, still has a high success rate of obstacle avoidance, and can complete obstacle avoidance path planning in a short time.