CoSense: Bridging Real-Time Performance and Fine-Grained Detail in mmWave Sensing
- 23 February 2026
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Mobile Computing
- Vol. 25 (8) , 11381-11396
Abstract
Millimeter-wave (mmWave) radar offers significant potential for fine-grained sensing, yet transitioning from controlled laboratory environments to dynamic real-world applications remains challenging. Existing methods face a dichotomy: real-time point clouds sacrifice crucial signal details needed for sophisticated tasks, whereas information-rich raw data sensing imposes prohibitive transmission and computation overheads, often limiting analysis to offline settings and hindering real-time viability. To this end, we present CoSense, a real-time edge-end collaborative sensing system built on commodity mmWave radar (end) and edge intelligence. We first introduce a novel dual-stream data acquisition mechanism via realizing radar driver-level interfaces, enabling simultaneous transmission of point clouds and raw data. To bridge the fidelity-latency trade-off, we implement an adaptive transmission strategy via firmware modifications, selectively forwarding raw data segments (corresponding to regions of interest identified in the point cloud) for detailed fine-grained analysis, while continuously delivering point clouds for low-latency coarse-grained sensing and control loops. Furthermore, we incorporate closed-loop feedback beamforming, dynamically steering the radar beam based on real-time tracking to counteract motion-induced misalignment and enhance signal fidelity. Extensive evaluations under dynamic conditions demonstrate that CoSense successfully achieves real-time fine-grained sensing with high fidelity and manageable overhead.Keywords
Funding Information
- Key Projects of Jiangsu Provincial Basic Research Program (BK20243040)
- National Natural Science Foundation of China (92467202)
- National Natural Science Foundation of China (62272216)
- National Natural Science Foundation of China (62372224)
- National Natural Science Foundation of China (62502196)
- Basic research program of Jiangsu (BK20251207)
- Postdoctoral Fellowship Program of CPSF (GZB20250389)
- Collaborative Innovation Center of Novel Software Technology and Industrialization
This publication has 49 references indexed in Scilit:
- Wideband Transmissive Programmable Metasurface for Adaptive Millimeter‐Wave BeamformingLaser & Photonics Reviews, 2024
- hBP-Fi: Contactless Blood Pressure Monitoring via Deep-Analyzed Hemodynamics2024
- A Survey of mmWave-Based Human Sensing: Technology, Platforms and ApplicationsIEEE Communications Surveys & Tutorials, 2023
- mmFlexible: Flexible Directional Frequency Multiplexing for Multi-user mmWave Networks2023
- mmMIC: Multi-modal Speech Recognition based on mmWave Radar2023
- mmECG: Monitoring Human Cardiac Cycle in Driving Environments Leveraging Millimeter Wave2022
- mmTrack: Passive Multi-Person Localization Using Commodity Millimeter Wave Radio2020
- Millimeter Wave Communication: A Comprehensive SurveyIEEE Communications Surveys & Tutorials, 2018
- Efficient Beam Alignment in Millimeter Wave Systems Using Contextual Bandits2018
- A sensitivity analysis of the MUSIC algorithmIEEE Transactions on Acoustics, Speech, and Signal Processing, 1990