Learning-Based Tracking-Before-Detect for Unconstrained Indoor Human Tracking Using RF Signal
- 14 January 2025
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 24 (6) , 4777-4793
Abstract
Human tracking plays a crucial role in various wireless sensing applications. However, recent advancements have primarily focused on constrained experimental scenarios with less interference, often involving a few individuals performing actions in an empty space without obstacles. In empirical unconstrained scenarios, such as daily office scenes, severe interference and attenuation caused by chaotic environments is inevitable which results in dramatic performance degradation. In this paper, we introduce TBDNet, which incorporates tracking-before-detect (TBD) from conventional signal processing into learning-based models, achieving impressive tracking performance in unconstrained scenarios. TBDNet follows first-track-then-detect pipeline. It maps input heatmap sequence into high-level frame-wise features to adapt the time-varying intensity distribution and motion pattern of targets. After that, the temporal information is accumulated in feature space to obtain trace proposals. We then predict the accurate positions and probability of traces at each timestamp. To assess the efficiency of TBDNet, we collect and release the first RF-UNIT (RF-based Unconstrained Indoor Tracking) dataset, which comprises 4,030,880 radar heatmaps and the corresponding tracking annotations under 6 different scenarios. To our knowledge, RF-UNIT is the first dataset for RF-based human tracking in unconstrained scenes. We anticipate that TBDNet and the RF-UNIT dataset will significantly contribute to the advancement of RF-based sensing technologies.Keywords
Funding Information
- National Natural Science Foundation of China (62201542, 62172381)
- Anhui Key R&D Project (2022h11020026)
- Fundamental Research Funds for the Central Universities
This publication has 52 references indexed in Scilit:
- FairMOT: On the Fairness of Detection and Re-identification in Multiple Object TrackingInternational Journal of Computer Vision, 2021
- Rethinking of Radar’s Role: A Camera-Radar Dataset and Systematic Annotator via Coordinate Alignment2021
- Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather2020
- nuScenes: A Multimodal Dataset for Autonomous Driving2020
- Through-Wall Human Pose Estimation Using Radio Signals2018
- PhaseBeat: Exploiting CSI Phase Data for Vital Sign Monitoring with Commodity WiFi Devices2017
- You Only Look Once: Unified, Real-Time Object Detection2016
- An adaptive wireless passive human detection via fine-grained physical layer informationAd Hoc Networks, 2016
- Estimation with Applications to Tracking and Navigation2002
- A flexible new technique for camera calibrationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2000