Kai Wang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Research Subjects
Kai Wang has a total of 9 co-authors. Here are the top co-authors by number of shared publications:
- Dequan Wang
University of Science and Technology of China, Hefei, China
2 shared publications - Lingyu Wang
University of Science and Technology of China, Hefei, China
2 shared publications - Xiaoran Fan
Google, Mountain View, USA
2 shared publications - Yanyong Zhang
University of Science and Technology of China, Hefei, Anhui, China
2 shared publications - Chengzhen Meng
University of Science and Technology of China, Hefei, China
1 shared publication - Chenming He
University of Science and Technology of China, Hefei, China
1 shared publication
Latest Publications
- Open Access
- 2 December 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (4) , 1-33
mmMUSE: An mmWave-based Motion-resilient Universal Speech Enhancement System
Speech enhancement improves the user interaction experience in voice-based smart systems. While microphone-based speech perception is limited by airborne noise, mmWave is immune to such interference. However, user-device motion hinders mmWave-based vocal extraction, dispersing vocal signals and introducing distortions. In this paper, we propose mmMUSE , an mmWave-based motion-resilient universal speech enhancement system that integrates mmWave and audio. To mitigate motion interference, we propose a two-stage method for robust vocal vibration extraction. Moreover, by proposing the Vocal-Noise-Ratio metric to assess the prominence of the vocal vibration, we enable real-time voice activity detection. We also design a complex-valued network that includes an attention-based fusion network for cross-modal complementing and a time-frequency masking network for correcting amplitude and phase of speech to isolate noises. Using datasets from 46 participants, mmMUSE outperforms the state-of-the-art speech enhancement models by 26% in SISDR and 34% in STOI on average. It also achieves SISDR improvements of 16.72 dB, 17.93 dB, 14.93 dB, and 18.95 dB in controlled environments involving intense noise, extensive motion, multiple speakers, and various obstructive materials, respectively. Finally, in real-world scenarios, including running, public spaces, and driving, mmMUSE achieves WER below 10%.
- 2 December 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (4) , 1-33
Open AccessmmMUSE: An mmWave-based Motion-resilient Universal Speech Enhancement System
Speech enhancement improves the user interaction experience in voice-based smart systems. While microphone-based speech perception is limited by airborne noise, mmWave is immune to such interference. However, user-device motion hinders mmWave-based vocal extraction, dispersing vocal signals and introducing distortions. In this paper, we propose mmMUSE , an mmWave-based motion-resilient universal speech enhancement system that integrates mmWave and audio. To mitigate motion interference, we propose a two-stage method for robust vocal vibration extraction. Moreover, by proposing the Vocal-Noise-Ratio metric to assess the prominence of the vocal vibration, we enable real-time voice activity detection. We also design a complex-valued network that includes an attention-based fusion network for cross-modal complementing and a time-frequency masking network for correcting amplitude and phase of speech to isolate noises. Using datasets from 46 participants, mmMUSE outperforms the state-of-the-art speech enhancement models by 26% in SISDR and 34% in STOI on average. It also achieves SISDR improvements of 16.72 dB, 17.93 dB, 14.93 dB, and 18.95 dB in controlled environments involving intense noise, extensive motion, multiple speakers, and various obstructive materials, respectively. Finally, in real-world scenarios, including running, public spaces, and driving, mmMUSE achieves WER below 10%.
- Open Access
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-31
RDGait: A mmWave Based Gait User Recognition System for Complex Indoor Environments Using Single-chip Radar
In this paper, we aim to study millimeter-wave-based gait recognition in complex indoor environments, focusing on dealing with multipath ghosts and supporting rapid deployment to new environments. We design a ghost detection algorithm based on velocity change patterns. This algorithm relies solely on velocity estimation, requiring no environmental priors or multipath modeling. Hence, it is suitable for single-chip millimeter-wave radar with low angular resolution and can be conveniently deployed in new indoor settings. In addition, we build a gait recognition network based on an attention-based Recurrent Neural Network (RNN) to extract spatiotemporal-velocity features from RD heatmaps. We have evaluated RDGait in two scenarios: a corridor scenario and a crowded office scenario, with 125 volunteers of different genders and ages ranging from 6 to 63. RDGait achieves a user recognition accuracy exceeding 95% among 125 candidates in both scenarios. We have further deployed RDGait in two additional scenarios using the pretrain-finetune approach. With minimal user registration data, RDGait could achieve satisfactory (> 90%) recognition accuracy in these new environments considering different radar placements, heights, and number of co-existing users.
- 22 August 2024
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 8 (3) , 1-31
Open AccessRDGait: A mmWave Based Gait User Recognition System for Complex Indoor Environments Using Single-chip Radar
In this paper, we aim to study millimeter-wave-based gait recognition in complex indoor environments, focusing on dealing with multipath ghosts and supporting rapid deployment to new environments. We design a ghost detection algorithm based on velocity change patterns. This algorithm relies solely on velocity estimation, requiring no environmental priors or multipath modeling. Hence, it is suitable for single-chip millimeter-wave radar with low angular resolution and can be conveniently deployed in new indoor settings. In addition, we build a gait recognition network based on an attention-based Recurrent Neural Network (RNN) to extract spatiotemporal-velocity features from RD heatmaps. We have evaluated RDGait in two scenarios: a corridor scenario and a crowded office scenario, with 125 volunteers of different genders and ages ranging from 6 to 63. RDGait achieves a user recognition accuracy exceeding 95% among 125 candidates in both scenarios. We have further deployed RDGait in two additional scenarios using the pretrain-finetune approach. With minimal user registration data, RDGait could achieve satisfactory (> 90%) recognition accuracy in these new environments considering different radar placements, heights, and number of co-existing users.