GAN Based Audio Noise Suppression for Victim Detection at Disaster Sites With UAV
Open Access
- 1 December 2023
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Services Computing
- Vol. 17 (1) , 183-193
Abstract
This paper presents a noise suppression system designed for unmanned aerial vehicles (UAVs). Searching for people using robots is expected to become a useful tool for saving lives during disasters. In particular, because UAVs can collect information from the air, there has been much research in rescue support using UAVs equipped with cameras. However, a limitation of cameras is their difficulty in detecting victims who are concealed. To solve this problem, we propose the use of a listening device on UAVs to detect sounds created by humans. This device uses an on-UAV microphone to capture human voices, which often get mixed with the sound of the UAV's propellers. This mixing presents a major challenge in identifying human voices. In this paper, we introduce a method to suppress the UAV propeller sound noise from the mix, enhancing the clarity of the human voice. Suppression of UAV sound noise is performed by generating pseudo-UAV sound based on generative adversarial networks (GAN) and reducing the generated pseudo-UAV sound from the sound mixture. By conducting various types of experiments, we confirmed the effectiveness of our proposal. As a result, we established the feasibility of using UAV-based voice processing for victim detection at disaster sites.Keywords
Funding Information
- Japan Society for the Promotion of Science-Grant-in-Aid for Scientific Research (21K04592)
This publication has 30 references indexed in Scilit:
- On-the-Fly Audio Source Separation—A Novel User-Friendly FrameworkIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2016
- UAV-assisted disaster management: Applications and open issues2016
- Visual monitoring of civil infrastructure systems via camera-equipped Unmanned Aerial Vehicles (UAVs): a review of related worksVisualization in Engineering, 2016
- U-Net: Convolutional Networks for Biomedical Image Segmentation2015
- Super-Audible Voice Activity DetectionIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- Rescue robots at earthquake-hit Mirandola, Italy: A field report2012
- Minimum snap trajectory generation and control for quadrotors2011
- Real-time people and vehicle detection from UAV imagery2011
- Measurements of acceptable levels, unacceptable levels and uncomfortable loudness levels of environmental sounds in persons with normal hearingAUDIOLOGY JAPAN, 2011
- An algorithm for the machine calculation of complex Fourier seriesMathematics of Computation, 1965