Synthesizing mmWave range-doppler data from videos for privacy-preserving human activity recognition
Open Access
- 16 January 2026
- journal article
- research article
- Published by Springer Nature in CCF Transactions on Pervasive Computing and Interaction
- Vol. 8 (1) , 116-129
Abstract
Millimeter-wave radar has shown significant potential in privacy-preserving human activity recognition. However, the lack of diverse radar datasets across various scenarios poses a challenge to the robustness and generalization of deep learning models. To address this limitation, existing works mainly focus on synthesizing micro-doppler data from video, range-doppler data, which provides an extra dimension, has been overlooked due to challenges caused by signal offsets. In this paper, we propose a comprehensive approach for synthesizing range-doppler data from videos by leveraging computer vision techniques and principles of camera imaging. Furthermore, we implement a map enhancement and classification model to facilitate human activity recognition. Our approach is validated on a custom dataset, where the proposed range-doppler synthesis method and classification model achieve an accuracy of 97.3% for activity recognition tasks. This performance is comparable to that of vision-based HAR methods, demonstrating the effectiveness of our proposed scheme in achieving privacy-preserving human activity recognition.Keywords
Funding Information
- Major Project of Fundamental Research on Frontier Leading Technology of Jiangsu Province (BK20222006)
This publication has 51 references indexed in Scilit:
- CMPIR: cross-modal pose image reconstruction via style-semantic fusionCCF Transactions on Pervasive Computing and Interaction, 2025
- Research on pedestrian counting based on millimeter waveCCF Transactions on Pervasive Computing and Interaction, 2024
- Human activity recognition based on multi-modal fusionCCF Transactions on Pervasive Computing and Interaction, 2023
- A fine-grained gesture tracking system based on millimeter-waveCCF Transactions on Pervasive Computing and Interaction, 2022
- Gesture recognition with RFID: an experimental studyCCF Transactions on Pervasive Computing and Interaction, 2021
- EEG-based emotion recognition via capsule network with channel-wise attention and LSTM modelsCCF Transactions on Pervasive Computing and Interaction, 2021
- WiFi CSI-based device-free sensing: from Fresnel zone model to CSI-ratio modelCCF Transactions on Pervasive Computing and Interaction, 2021
- Study on feasibility of remote metal detection using millimeter wave radar for convenient and efficient security checkCCF Transactions on Pervasive Computing and Interaction, 2021
- Device free human activity and fall recognition using WiFi channel state information (CSI)CCF Transactions on Pervasive Computing and Interaction, 2020
- Learning Long-Term Temporal Features With Deep Neural Networks for Human Action RecognitionIEEE Access, 2019