Xie Zhang
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Xie Zhang has a total of 11 co-authors. Here are the top co-authors by number of shared publications:
- Chenshu Wu
The University of Hong Kong, Hong Kong, Hong Kong
6 shared publications - Chengpei Tang
School of Intelligent Systems Engineering, Sun Yat-sen University, Guangzhou, China
2 shared publications - Chengxiao Li
The University of Hong Kong, Hong Kong, China
2 shared publications - Kang Yin
School of Intelligent Systems Engineering, Sun Yat-sen University, Guangzhou, China
2 shared publications - Liu Xuan
The University of Hong Kong, Hong Kong, China
2 shared publications - Jianqi Zhang
The University of Hong Kong, Hong Kong, China
1 shared publication
Latest Publications
- Open Access
- 26 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1428-1446
TAP3D: Thermal-Assisted 3D Human Point Clouds
- 26 October 2026
- Published by Association for Computing Machinery (ACM)
- p. 1428-1446
Open AccessTAP3D: Thermal-Assisted 3D Human Point Clouds
- Open Access
- 30 September 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (3) , 1-35
Towards White-Box Deep Wireless Sensing
The empirical success of deep learning has spurred its application to the radio-frequency (RF) domain, leading to significant advances in Deep Wireless Sensing (DWS). However, most existing DWS models remain black boxes, with ad-hoc architectures and learned representations lacking explicit physical and mathematical grounding, which limits their reliability and generalizability in real-world deployments. We present RF-CRATE, an early step towards white-box DWS grounded in the complex sparse rate reduction principle. Using the ℂℝ-Calculus framework, we derive a fully complex-valued transformer with mathematically interpretable self-attention and residual modules. To address labeled data scarcity, we introduce subspace regularization to enhance representation diversity, yielding a 19.98% average improvement. We evaluate RF-CRATE across heterogeneous RF modalities and human sensing tasks, including activity, gait, and gesture recognition, pose estimation, and respiration monitoring. Experiments on five datasets show that RF-CRATE remains competitive with strong black-box models while providing mathematically interpretable architectures and representations. Moreover, the complex-valued design achieves a 3.39% gain in classification accuracy and a 10.34% reduction in regression error. Our results demonstrate that mathematically grounded models can achieve strong performance in wireless sensing, offering a promising step towards physically aligned white-box DWS systems.
- 30 September 2026
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 10 (3) , 1-35
Open AccessTowards White-Box Deep Wireless Sensing
The empirical success of deep learning has spurred its application to the radio-frequency (RF) domain, leading to significant advances in Deep Wireless Sensing (DWS). However, most existing DWS models remain black boxes, with ad-hoc architectures and learned representations lacking explicit physical and mathematical grounding, which limits their reliability and generalizability in real-world deployments. We present RF-CRATE, an early step towards white-box DWS grounded in the complex sparse rate reduction principle. Using the ℂℝ-Calculus framework, we derive a fully complex-valued transformer with mathematically interpretable self-attention and residual modules. To address labeled data scarcity, we introduce subspace regularization to enhance representation diversity, yielding a 19.98% average improvement. We evaluate RF-CRATE across heterogeneous RF modalities and human sensing tasks, including activity, gait, and gesture recognition, pose estimation, and respiration monitoring. Experiments on five datasets show that RF-CRATE remains competitive with strong black-box models while providing mathematically interpretable architectures and representations. Moreover, the complex-valued design achieves a 3.39% gain in classification accuracy and a 10.34% reduction in regression error. Our results demonstrate that mathematically grounded models can achieve strong performance in wireless sensing, offering a promising step towards physically aligned white-box DWS systems.
- Open Access
- 20 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 122-123
From Body Heat to Behavioral Horizons: Spatial Sensing Intelligence with Thermal Arrays
- 20 June 2026
- Published by Association for Computing Machinery (ACM)
- p. 122-123
Open AccessFrom Body Heat to Behavioral Horizons: Spatial Sensing Intelligence with Thermal Arrays
- Open Access
- 4 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 34-39
ThermalEye: Fully Passive Eye Blink Detection on Smart Glasses via Low-Cost Thermal Sensing
- 4 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 34-39
Open AccessThermalEye: Fully Passive Eye Blink Detection on Smart Glasses via Low-Cost Thermal Sensing
- Open Access
- 4 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Privacy-Preserving Non-Contact Sleep Monitoring via Multimodal Thermal-Depth Sensing
- 4 November 2025
- Published by Association for Computing Machinery (ACM)
- p. 1-6
Open AccessPrivacy-Preserving Non-Contact Sleep Monitoring via Multimodal Thermal-Depth Sensing
- Open Access
- 9 June 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (2) , 1-25
TAPOR: 3D Hand Pose Reconstruction with Fully Passive Thermal Sensing for Around-Device Interactions
This paper presents the design and implementation of TAPOR, a privacy-preserving, non-contact, and fully passive sensing system for accurate and robust 3D hand pose reconstruction for around-device interaction using a single low-cost thermal array sensor. Thermal sensing using inexpensive and miniature thermal arrays emerges with an excellent utility-privacy balance, offering an imaging resolution significantly lower than cameras but far superior to RF signals like radar or WiFi. The design of TAPOR, however, is challenging, mainly because the captured temperature maps are low-resolution and textureless. To overcome the challenges, we investigate thermo-depth and thermo-pose properties, proposing a novel physics-inspired neural network that learns effective 3D spatial representations of potential hand poses. We then formulate the 3D pose reconstruction problem as a distinct retrieval task, enabling accurate hand pose determination from the input temperature map. To deploy TAPOR on IoT devices, we introduce an effective heterogeneous knowledge distillation method, reducing computation by 377×. TAPOR is fully implemented and tested in real-world scenarios, showing remarkable performance, supported by four gesture control and finger tracking case studies. We envision TAPOR to be a ubiquitous interface for around-device control and have open-sourced it at https://github.com/aiot-lab/TAPOR.
- 9 June 2025
- Published by Association for Computing Machinery (ACM) in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Vol. 9 (2) , 1-25
Open AccessTAPOR: 3D Hand Pose Reconstruction with Fully Passive Thermal Sensing for Around-Device Interactions
This paper presents the design and implementation of TAPOR, a privacy-preserving, non-contact, and fully passive sensing system for accurate and robust 3D hand pose reconstruction for around-device interaction using a single low-cost thermal array sensor. Thermal sensing using inexpensive and miniature thermal arrays emerges with an excellent utility-privacy balance, offering an imaging resolution significantly lower than cameras but far superior to RF signals like radar or WiFi. The design of TAPOR, however, is challenging, mainly because the captured temperature maps are low-resolution and textureless. To overcome the challenges, we investigate thermo-depth and thermo-pose properties, proposing a novel physics-inspired neural network that learns effective 3D spatial representations of potential hand poses. We then formulate the 3D pose reconstruction problem as a distinct retrieval task, enabling accurate hand pose determination from the input temperature map. To deploy TAPOR on IoT devices, we introduce an effective heterogeneous knowledge distillation method, reducing computation by 377×. TAPOR is fully implemented and tested in real-world scenarios, showing remarkable performance, supported by four gesture control and finger tracking case studies. We envision TAPOR to be a ubiquitous interface for around-device control and have open-sourced it at https://github.com/aiot-lab/TAPOR.
- Open Access
- 14 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 11-20
TADAR: Thermal Array-based Detection and Ranging for Privacy-Preserving Human Sensing
Human sensing has gained increasing attention in various applications. Among the available technologies, visual images offer high accuracy, while sensing on the RF spectrum preserves privacy, creating a conflict between imaging resolution and privacy preservation. In this paper, we explore thermal array sensors as an emerging modality that strikes an excellent resolution-privacy balance for ubiquitous sensing. To this end, we present TADAR, the first multi-user Thermal Array-based Detection and Ranging system that estimates the inherently missing range information, extending thermal array outputs from 2D thermal pixels to 3D depths and empowering them as a promising modality for ubiquitous privacy-preserving human sensing. We prototype TADAR using a single commodity thermal array sensor and conduct extensive experiments in different indoor environments. Our results show that TADAR achieves a mean F1 score of 88.8% for multi-user detection and a mean accuracy of 32.0 cm for multi-user ranging, which further improves to 20.1 cm for targets located within 3 m. We conduct two case studies on fall detection and occupancy estimation to showcase the potential applications of TADAR. We hope TADAR will inspire the vast community to explore new directions of thermal array sensing, beyond wireless and acoustic sensing. TADAR is open-sourced on GitHub: https://github.com/aiot-lab/TADAR.
- 14 October 2024
- Published by Association for Computing Machinery (ACM)
- p. 11-20
Open AccessTADAR: Thermal Array-based Detection and Ranging for Privacy-Preserving Human Sensing
Human sensing has gained increasing attention in various applications. Among the available technologies, visual images offer high accuracy, while sensing on the RF spectrum preserves privacy, creating a conflict between imaging resolution and privacy preservation. In this paper, we explore thermal array sensors as an emerging modality that strikes an excellent resolution-privacy balance for ubiquitous sensing. To this end, we present TADAR, the first multi-user Thermal Array-based Detection and Ranging system that estimates the inherently missing range information, extending thermal array outputs from 2D thermal pixels to 3D depths and empowering them as a promising modality for ubiquitous privacy-preserving human sensing. We prototype TADAR using a single commodity thermal array sensor and conduct extensive experiments in different indoor environments. Our results show that TADAR achieves a mean F1 score of 88.8% for multi-user detection and a mean accuracy of 32.0 cm for multi-user ranging, which further improves to 20.1 cm for targets located within 3 m. We conduct two case studies on fall detection and occupancy estimation to showcase the potential applications of TADAR. We hope TADAR will inspire the vast community to explore new directions of thermal array sensing, beyond wireless and acoustic sensing. TADAR is open-sourced on GitHub: https://github.com/aiot-lab/TADAR.
- 21 September 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (11) , 8584-8596
WiFi-Based Cross-Domain Gesture Recognition via Modified Prototypical Networks
Numerous deep learning studies have achieved remarkable advances in WiFi-based human gesture recognition (HGR) using channel state information (CSI). However, since the CSI patterns of the same gesture change across domains (i.e., users, environments, locations, and orientations), recognition accuracy might degrade significantly when applying the trained model to new domains. To overcome this problem, we propose a WiFi-based cross-domain gesture recognition system (WiGr) which has a domain-transferable mapping to construct an embedding space where the representations of samples from the same class are clustered, and those from different classes are separated. The key insight of WiGr is using the similarity between the query sample representation and the class prototypes in the embedding space to perform the gesture classification, which can avoid the influence of the cross-domain CSI patterns change. Meanwhile, we present a dual-path prototypical network (Dual-Path PN) which consists of a deep feature extractor and a dual-path (i.e., Path-A and Path-B substructures) recognizer. The trained feature extractor can extract the gesture-related domain-independent features from CSI, namely, the domain-transferable mapping. In addition, WiGr implements the cross-domain HGR based on only a pair of WiFi devices without retraining in the new domain. We conduct comprehensive experiments on three data sets, one is built by ourselves and the others are public data sets. The evaluation suggests that WiGr achieves 86.8%–92.7% in-domain recognition accuracy and 83.5%–93% cross-domain accuracy under the four-shot condition.
- 21 September 2021
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 9 (11) , 8584-8596
WiFi-Based Cross-Domain Gesture Recognition via Modified Prototypical Networks
Numerous deep learning studies have achieved remarkable advances in WiFi-based human gesture recognition (HGR) using channel state information (CSI). However, since the CSI patterns of the same gesture change across domains (i.e., users, environments, locations, and orientations), recognition accuracy might degrade significantly when applying the trained model to new domains. To overcome this problem, we propose a WiFi-based cross-domain gesture recognition system (WiGr) which has a domain-transferable mapping to construct an embedding space where the representations of samples from the same class are clustered, and those from different classes are separated. The key insight of WiGr is using the similarity between the query sample representation and the class prototypes in the embedding space to perform the gesture classification, which can avoid the influence of the cross-domain CSI patterns change. Meanwhile, we present a dual-path prototypical network (Dual-Path PN) which consists of a deep feature extractor and a dual-path (i.e., Path-A and Path-B substructures) recognizer. The trained feature extractor can extract the gesture-related domain-independent features from CSI, namely, the domain-transferable mapping. In addition, WiGr implements the cross-domain HGR based on only a pair of WiFi devices without retraining in the new domain. We conduct comprehensive experiments on three data sets, one is built by ourselves and the others are public data sets. The evaluation suggests that WiGr achieves 86.8%–92.7% in-domain recognition accuracy and 83.5%–93% cross-domain accuracy under the four-shot condition.
- Open Access
- 7 April 2021
- Published by MDPI AG in Applied Sciences
- Vol. 11 (8) , 3329
WiGR: A Practical Wi-Fi-Based Gesture Recognition System with a Lightweight Few-Shot Network
Wi-Fi sensing technology based on deep learning has contributed many breakthroughs in gesture recognition tasks. However, most methods concentrate on single domain recognition with high computational complexity while rarely investigating cross-domain recognition with lightweight performance, which cannot meet the requirements of high recognition performance and low computational complexity in an actual gesture recognition system. Inspired by the few-shot learning methods, we propose WiGR, a Wi-Fi-based gesture recognition system. The key structure of WiGR is a lightweight few-shot learning network that introduces some lightweight blocks to achieve lower computational complexity. Moreover, the network can learn a transferable similarity evaluation ability from the training set and apply the learned knowledge to the new domain to address domain shift problems. In addition, we made a channel state information (CSI)-Domain Adaptation (CSIDA) data set that includes channel state information (CSI) traces with various domain factors (i.e., environment, users, and locations) and conducted extensive experiments on two data sets (CSIDA and SignFi). The evaluation results show that WiGR can reach 87.8–94.8% cross-domain accuracy, and the parameters and the calculations are reduced by more than 50%. Extensive experiments demonstrate that WiGR can achieve excellent recognition performance using only a few samples and is thus a lightweight and practical gesture recognition system compared with state-of-the-art methods.
- 7 April 2021
- Published by MDPI AG in Applied Sciences
- Vol. 11 (8) , 3329
Open AccessWiGR: A Practical Wi-Fi-Based Gesture Recognition System with a Lightweight Few-Shot Network
Wi-Fi sensing technology based on deep learning has contributed many breakthroughs in gesture recognition tasks. However, most methods concentrate on single domain recognition with high computational complexity while rarely investigating cross-domain recognition with lightweight performance, which cannot meet the requirements of high recognition performance and low computational complexity in an actual gesture recognition system. Inspired by the few-shot learning methods, we propose WiGR, a Wi-Fi-based gesture recognition system. The key structure of WiGR is a lightweight few-shot learning network that introduces some lightweight blocks to achieve lower computational complexity. Moreover, the network can learn a transferable similarity evaluation ability from the training set and apply the learned knowledge to the new domain to address domain shift problems. In addition, we made a channel state information (CSI)-Domain Adaptation (CSIDA) data set that includes channel state information (CSI) traces with various domain factors (i.e., environment, users, and locations) and conducted extensive experiments on two data sets (CSIDA and SignFi). The evaluation results show that WiGR can reach 87.8–94.8% cross-domain accuracy, and the parameters and the calculations are reduced by more than 50%. Extensive experiments demonstrate that WiGR can achieve excellent recognition performance using only a few samples and is thus a lightweight and practical gesture recognition system compared with state-of-the-art methods.