RadioMic: Sound Sensing via Radio Signals
- 28 October 2022
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Internet of Things Journal
- Vol. 10 (5) , 4431-4448
Abstract
Voice interfaces have become an integral part of our lives with the proliferation of smart devices. Today, Internet of Things devices mainly rely on microphones to sense sound. Microphones, however, have fundamental limitations, such as weak source separation, limited range in the presence of acoustic insulation, and being prone to multiple side-channel attacks. In this article, we propose RadioMic, a radio-based sound sensing system to mitigate these issues and enrich sound applications. RadioMic constructs sound based on tiny vibrations on active sources (e.g., a speaker diaphragm) or object surfaces (e.g., paper bag), and can work through walls, even a soundproof one. To convert the extremely weak sound vibration in the radio signals into sound signals, RadioMic introduces radio acoustics, and presents training-free approaches for robust sound detection and high-fidelity sound recovery. It then exploits a neural network to further enhance the recovered sound by expanding the recoverable frequencies and reducing the noises. RadioMic translates massive online audios to synthesized data to train the network and, thus, minimizes the need for radio-frequency (RF) data. We thoroughly evaluate different components of RadioMic under different scenarios using a commodity mmWave radar. The results show RadioMic outperforms the state-of-the-art systems significantly. We believe RadioMic provides new horizons for sound sensing and inspires attractive sensing capabilities of mmWave sensing devices.Keywords
All Related Versions
This publication has 72 references indexed in Scilit:
- AccelWord2015
- Turning a Mobile Device into a Mouse in the Air2015
- Smart Homes that Monitor Breathing and Heart Rate2015
- A deep neural network approach to speech bandwidth expansion2015
- The visual microphoneACM Transactions on Graphics, 2014
- Vocal fold vibration measurements using laser Doppler vibrometryThe Journal of the Acoustical Society of America, 2013
- Millimeter Wave Radar for detecting the speech signal applicationsInternational Journal of Infrared and Millimeter Waves, 1996
- Three-dimensional reconstruction of cardiac displacement patterns on the chest wall during the P, QRS and T-segments of the ECG by laser speckle inteferometryMedical & Biological Engineering & Computing, 1989
- Laser microphoneThe Journal of the Acoustical Society of America, 1984
- Suppression of acoustic noise in speech using spectral subtractionIEEE Transactions on Acoustics, Speech, and Signal Processing, 1979