Semantic regularization of electromagnetic inverse problems
Open Access
- 8 May 2024
- journal article
- research article
- Published by Springer Nature in Nature Communications
- Vol. 15 (1) , 1-12
Abstract
Solving ill-posed inverse problems typically requires regularization based on prior knowledge. To date, only prior knowledge that is formulated mathematically (e.g., sparsity of the unknown) or implicitly learned from quantitative data can be used for regularization. Thereby, semantically formulated prior knowledge derived from human reasoning and recognition is excluded. Here, we introduce and demonstrate the concept of semantic regularization based on a pre-trained large language model to overcome this vexing limitation. We study the approach, first, numerically in a prototypical 2D inverse scattering problem, and, second, experimentally in 3D and 4D compressive microwave imaging problems based on programmable metasurfaces. We highlight that semantic regularization enables new forms of highly-sought privacy protection for applications like smart homes, touchless human-machine interaction and security screening: selected subjects in the scene can be concealed, or their actions and postures can be altered in the reconstruction by manipulating the semantic prior with suitable language-based control commands.Keywords
This publication has 47 references indexed in Scilit:
- Zero-shot visual reasoning through probabilistic analogical mappingNature Communications, 2023
- Intelligent Electromagnetic Sensing with Learnable Data Acquisition and ProcessingPatterns, 2020
- Learned Integrated Sensing Pipeline: Reconfigurable Metasurface Transceivers as Trainable Physical Layer in an Artificial Neural NetworkAdvanced Science, 2019
- Intelligent metasurface imager and recognizerLight: Science & Applications, 2019
- Machine-learning reprogrammable metasurface imagerNature Communications, 2019
- Plasmonic nanostructure design and characterization via Deep LearningLight: Science & Applications, 2018
- Big–deep–smart data in imaging for guiding materials designNature Materials, 2015
- Bayes' theoremNature Methods, 2015
- Tree Topology EstimationIEEE Transactions on Pattern Analysis and Machine Intelligence, 2014
- Metamaterial Apertures for Computational ImagingScience, 2013