A Tandem Algorithm for Singing Pitch Extraction and Voice Separation From Music Accompaniment
- 2 January 2012
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 20 (5) , 1482-1491
Abstract
Singing pitch estimation and singing voice separation are challenging due to the presence of music accompaniments that are often nonstationary and harmonic. Inspired by computational auditory scene analysis (CASA), this paper investigates a tandem algorithm that estimates the singing pitch and separates the singing voice jointly and iteratively. Rough pitches are first estimated and then used to separate the target singer by considering harmonicity and temporal continuity. The separated singing voice and estimated pitches are used to improve each other iteratively. To enhance the performance of the tandem algorithm for dealing with musical recordings, we propose a trend estimation algorithm to detect the pitch ranges of a singing voice in each time frame. The detected trend substantially reduces the difficulty of singing pitch detection by removing a large number of wrong pitch candidates either produced by musical instruments or the overtones of the singing voice. Systematic evaluation shows that the tandem algorithm outperforms previous systems for pitch extraction and singing voice separation.Keywords
This publication has 19 references indexed in Scilit:
- Singer melody extraction in polyphonic signals using source separation methods2008
- On Ideal Binary Mask As the Computational Goal of Auditory Scene Analysis2006
- Automatic Synchronization between Lyrics and Music CD Recordings Based on Viterbi Alignment of Segregated Vocal Signals2006
- LyricAlly2004
- Monaural Speech Segregation Based on Pitch Tracking and Amplitude ModulationIEEE Transactions on Neural Networks, 2004
- A real-time music-scene-description system: predominant-F0 estimation for detecting melody and bass lines in real-world audio signalsSpeech Communication, 2004
- Separation of speech from interfering sounds based on oscillatory correlationIEEE Transactions on Neural Networks, 1999
- Computational auditory scene analysisComputer Speech & Language, 1994
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982