Edge-Deployed Band-Split Rotary Position Encoding Transformer for Ultra-Low-Signal-to-Noise-Ratio Unmanned Aerial Vehicle Speech Enhancement
Open Access
Abstract
Addressing the significant challenge of speech enhancement in ultra-low-Signal-to-Noise-Ratio (SNR) scenarios for Unmanned Aerial Vehicle (UAV) voice communication, particularly under edge deployment constraints, this study proposes the Edge-Deployed Band-Split Rotary Position Encoding Transformer (Edge-BS-RoFormer), a novel, lightweight band-split rotary position encoding transformer. While existing deep learning methods face limitations in dynamic UAV noise suppression under such constraints, including insufficient harmonic modeling and high computational complexity, the proposed Edge-BS-RoFormer distinctively synergizes a band-split strategy for fine-grained spectral processing, a dual-dimension Rotary Position Encoding () mechanism for superior joint time–frequency modeling, and to optimize computational efficiency, pivotal for its lightweight nature and robust ultra-low-SNR performance. Experiments on our self-constructed DroneNoise-LibriMix (DN-LM) dataset demonstrate Edge-BS-RoFormer’s superiority. Under a −15 dB SNR, it achieves Scale-Invariant Signal-to-Distortion Ratio (SI-SDR) improvements of 2.2 dB over Deep Complex U-Net (DCUNet), 25.0 dB over the Dual-Path Transformer Network (DPTNet), and 2.3 dB over HTDemucs. Correspondingly, the Perceptual Evaluation of Speech Quality (PESQ) is enhanced by 0.11, 0.18, and 0.15, respectively. Crucially, its efficacy for edge deployment is substantiated by a minimal model storage of 8.534 MB, 11.617 GFLOPs (an 89.6% reduction vs. DCUNet), a runtime memory footprint of under 500MB, a Real-Time Factor (RTF) of 0.325 (latency: 330.830 ms), and a power consumption of 6.536 W on an NVIDIA Jetson AGX Xavier, fulfilling real-time processing demands. This study delivers a validated lightweight solution, exemplified by its minimal computational overhead and real-time edge inference capability, for effective speech enhancement in complex UAV acoustic scenarios, including dynamic noise conditions. Furthermore, the open-sourced dataset and model contribute to advancing research and establishing standardized evaluation frameworks in this domain.
Keywords
This publication has 46 references indexed in Scilit:
- DPSNN: spiking neural network for low-latency streaming speech enhancementNeuromorphic Computing and Engineering, 2024
- Exploring the role of drones and UAVs in logistics and supply chain management: a novel text-based literature reviewInternational Journal of Production Research, 2024
- Music Source Separation With Band-Split Rope Transformer2024
- Drone audition: Audio signal enhancement from drone embedded microphones using multichannel Wiener filtering and Gaussian-mixture based post-filteringApplied Acoustics, 2023
- Connecting Internet of Drones and Urban Computing: Methods, protocols and applicationsComputer Networks, 2023
- RoFormer: Enhanced transformer with Rotary Position EmbeddingNeurocomputing, 2023
- A survey on UAV-assisted wireless communications: Recent advances and future trendsComputer Communications, 2023
- Deep Learning Models for Single-Channel Speech Enhancement on DronesIEEE Access, 2023
- Microphone-Array Ego-Noise Reduction Algorithms for Auditory Micro Aerial VehiclesIEEE Sensors Journal, 2017
- Experimental analysis on the noise of propellers for small UAVApplied Acoustics, 2013