Zhiyuan Zhao
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Zhiyuan Zhao has a total of 6 co-authors. Here are the top co-authors by number of shared publications:
- Fan Li
School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China
2 shared publications - Yu Wang
Temple University, Philadelphia, PA, USA
2 shared publications - Qiuyang Zeng
School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China
1 shared publication - Yadong Xie
School of Software and BNRist, Tsinghua University, Beijing, China
1 shared publication - Youqi Li
School of Computer Science and Technology, Beijing Institute of Technology, Beijing, China
1 shared publication - Yue Wu
School of Software, Tsinghua University, Beijing, China
1 shared publication
Latest Publications
- 9 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (8) , 8557-8568
AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones
Off-screen handwriting recognition enriches the handwriting interaction paradigm for mobile devices. However, the existing approaches are only applicable to the specific environment and equipment conditions. In this article, we propose AcouWrite , a general, scalable and real-time handwriting recognition system based on active acoustic sensing. In detail, AcouWrite relies on active acoustic sensing using only a pair of microphones and speakers on the smartphone to capture real-time handwriting input. Particularly, we extract the short-time dCIR (st-dCIR) to monitor the changes in the acoustic transmission channel resulting from finger movement. Technically, we use a CNN-GRU classifier to complete the recognition task in AcouWrite. Moreover, we use data augmentation and spelling error correction methods to improve AcouWrite's robustness. To improve the generalization of our AcouWrite for new characters, we incorporate the transfer learning module into our AcouWrite. In various real-world environments, experiments demonstrate that AcouWrite achieves a mean recognition accuracy of 97.62%, a word accuracy (WA) of 96.4% and a character error rate (CER) of 1.5% for 100 common words, and an average response time of 94 milliseconds.
- 9 January 2024
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (8) , 8557-8568
AcouWrite: Acoustic-Based Handwriting Recognition on Smartphones
Off-screen handwriting recognition enriches the handwriting interaction paradigm for mobile devices. However, the existing approaches are only applicable to the specific environment and equipment conditions. In this article, we propose AcouWrite , a general, scalable and real-time handwriting recognition system based on active acoustic sensing. In detail, AcouWrite relies on active acoustic sensing using only a pair of microphones and speakers on the smartphone to capture real-time handwriting input. Particularly, we extract the short-time dCIR (st-dCIR) to monitor the changes in the acoustic transmission channel resulting from finger movement. Technically, we use a CNN-GRU classifier to complete the recognition task in AcouWrite. Moreover, we use data augmentation and spelling error correction methods to improve AcouWrite's robustness. To improve the generalization of our AcouWrite for new characters, we incorporate the transfer learning module into our AcouWrite. In various real-world environments, experiments demonstrate that AcouWrite achieves a mean recognition accuracy of 97.62%, a word accuracy (WA) of 96.4% and a character error rate (CER) of 1.5% for 100 common words, and an average response time of 94 milliseconds.
- 27 April 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (4) , 3213-3227
BSMonitor: Noise-Resistant Bowel Sound Monitoring via Earphones
Bowel sound (BS) is an important physiological signal of the human body, which is also an objective reflection of gastrointestinal motility. However, BS has characteristics of weak signal, strong noise, and randomicity, which bring great challenges to the daily detection of BS. In this paper, we propose BSMonitor, the first BS monitoring system with strong noise-resistant capability via earphones. BSMonitor uses one earphone attached to the abdomen to collect BS signals and the other earphone worn in the ear to collect external noises and internal noises. After eliminating the noises through the Kalman filter and band-pass filter, the signal containing BS is separated via the empirical mode decomposition. Then BSMonitor extracts MFCC features of BS signals and applies a carefully-designed LSTM network to perform highly-accurate BS detection. Finally, an alert mechanism calculates the frequency and duration of detected BS and compares with the normal values to alert users. Furthermore, to increase the amount and diversity of training data, we introduce a data augmentation method, which can further improve the accuracy and generalization of BSMonitor. Through extensive experiments with 18 volunteers, we find that BSMonitor not only achieves high accuracy of BS detection but also has strong generalization across different users and environments. Particularly, BSMonitor achieves accuracy up to 98.73% and 94.56% in the benchmark experiments and the cross experiments , respectively.
- 27 April 2023
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 23 (4) , 3213-3227
BSMonitor: Noise-Resistant Bowel Sound Monitoring via Earphones
Bowel sound (BS) is an important physiological signal of the human body, which is also an objective reflection of gastrointestinal motility. However, BS has characteristics of weak signal, strong noise, and randomicity, which bring great challenges to the daily detection of BS. In this paper, we propose BSMonitor, the first BS monitoring system with strong noise-resistant capability via earphones. BSMonitor uses one earphone attached to the abdomen to collect BS signals and the other earphone worn in the ear to collect external noises and internal noises. After eliminating the noises through the Kalman filter and band-pass filter, the signal containing BS is separated via the empirical mode decomposition. Then BSMonitor extracts MFCC features of BS signals and applies a carefully-designed LSTM network to perform highly-accurate BS detection. Finally, an alert mechanism calculates the frequency and duration of detected BS and compares with the normal values to alert users. Furthermore, to increase the amount and diversity of training data, we introduce a data augmentation method, which can further improve the accuracy and generalization of BSMonitor. Through extensive experiments with 18 volunteers, we find that BSMonitor not only achieves high accuracy of BS detection but also has strong generalization across different users and environments. Particularly, BSMonitor achieves accuracy up to 98.73% and 94.56% in the benchmark experiments and the cross experiments , respectively.