RFCanvas: Modeling RF Channel by Fusing Visual Priors and Few-shot RF Measurements
Open Access
- 4 November 2024
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 464-477
Abstract
Accurate and responsive simulation of radio frequency (RF) signal propagation is crucial for designing wireless systems operating in dynamic environments. Conventional ray tracing approaches struggle to accurately model the intricate geometries and material properties of objects that impact propagation. Recently proposed neural scene representations can learn such intricacies from RF data, but they treat the entire scene as implicit neural networks, necessitating retraining with a massive amount of RF data upon any environmental changes. In this paper, we propose RFCanvas, which fuses visual priors and RF measurements to achieve high accuracy for realistic scenes and be responsive to environmental changes. To ensure compatibility between visual priors and RF measurements, we introduce RFCanvas scene representations that model shapes and materials of substantial objects with tensorial fields and signed distance fields. We further extract motion information from visual priors to adapt RFCanvas scene representations to scene dynamics. RFCanvas is built upon an end-to-end optimization framework with differentiable RF simulation. Extensive evaluations across real-world wireless communication and sensing environments demonstrate RFCanvas's superiority over both existing methods.Keywords
Funding Information
- NSF (National Science Foundation) (CNS-2128588, CNS-2312715, CNS-2408393)
This publication has 32 references indexed in Scilit:
- A Dense Material Segmentation Dataset for Indoor and Outdoor Scene Parsing2022
- TensoRF: Tensorial Radiance Fields2022
- DeepSDF: Learning Continuous Signed Distance Functions for Shape Representation2019
- Imaging With WiFiIEEE Access, 2019
- Material Classification Using Raw Time-of-Flight Measurements2016
- Computational Electromagnetics: The Finite-Difference Time-Domain Method2005
- Measurements of reflection and transmission characteristics of interior structures of office building in the 60-GHz bandIEEE Transactions on Antennas and Propagation, 1997
- Sphere tracing: a geometric method for the antialiased ray tracing of implicit surfacesThe Visual Computer, 1996
- Shooting and bouncing rays: calculating the RCS of an arbitrarily shaped cavityIEEE Transactions on Antennas and Propagation, 1989
- Fronts propagating with curvature-dependent speed: Algorithms based on Hamilton-Jacobi formulationsJournal of Computational Physics, 1988