Global Rotation Equivariant Phase Modeling for Speech Enhancement with Deep Magnitude-Phase Interaction
Preprint
Abstract
While deep learning has advanced speech enhancement (SE), effective phase modeling remains challenging, as conventional networks typically operate within a flat Euclidean feature space, which is not easy to model the underlying circular topology of the phase. To address this, we propose a manifold-aware magnitude-phase dual-stream framework that aligns the phase stream with its intrinsic circular geometry by enforcing Global Rotation Equivariance (GRE) characteristic. Specifically, we introduce a Magnitude-Phase Interactive Convolutional Module (MPICM) for modulus-based information exchange and a Hybrid-Attention Dual-FFN (HADF) bottleneck for unified feature fusion, both of which are designed to preserve GRE in the phase stream. Comprehensive evaluations are conducted across phase retrieval, denoising, dereverberation, and bandwidth extension tasks to validate the superiority of the proposed method over multiple advanced baselines. Notably, the proposed architecture reduces Phase Distance by over 20\% in the phase retrieval task and improves PESQ by more than 0.1 in zero-shot cross-corpus denoising evaluations. The overall superiority is also established in universal SE tasks involving mixed distortions. Qualitative analysis further reveals that the learned phase features exhibit distinct periodic patterns, which are consistent with the intrinsic circular nature of the phase. The source code is available at https://github.com/wangchengzhong/RENet.Keywords
All Related Versions
This publication has 27 references indexed in Scilit:
- Explicit estimation of magnitude and phase spectra in parallel for high-quality speech enhancementNeural Networks, 2025
- Complex-Valued Neural Networks: A Comprehensive SurveyIEEE/CAA Journal of Automatica Sinica, 2022
- Two Heads are Better Than One: A Two-Stage Complex Spectral Mapping Approach for Monaural Speech EnhancementIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2021
- Phase Processing for Single-Channel Speech Enhancement: History and recent advancesIEEE Signal Processing Magazine, 2015
- A Regression Approach to Speech Enhancement Based on Deep Neural NetworksIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- On Training Targets for Supervised Speech SeparationIEEE/ACM Transactions on Audio, Speech, and Language Processing, 2014
- Group delay functions and its applications in speech technologySādhanā, 2011
- The importance of phase in speech enhancementSpeech Communication, 2011
- Evaluation of Objective Quality Measures for Speech EnhancementIEEE Transactions on Audio, Speech, and Language Processing, 2007
- Speech enhancement for non-stationary noise environmentsSignal Processing, 2001