Vocal Melody Extraction in the Presence of Pitched Accompaniment in Polyphonic Music
- 15 March 2010
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 18 (8) , 2145-2154
Abstract
Melody extraction algorithms for single-channel polyphonic music typically rely on the salience of the lead melodic instrument, considered here to be the singing voice. However the simultaneous presence of one or more pitched instruments in the polyphony can cause such a predominant-F0 tracker to switch between tracking the pitch of the voice and that of an instrument of comparable strength, resulting in reduced voice-pitch detection accuracy. We propose a system that, in addition to biasing the salience measure in favor of singing voice characteristics, acknowledges that the voice may not dominate the polyphony at all instants and therefore tracks an additional pitch to better deal with the potential presence of locally dominant pitched accompaniment. A feature based on the temporal instability of voice harmonics is used to finally identify the voice pitch. The proposed system is evaluated on test data that is representative of polyphonic music with strong pitched accompaniment. Results show that the proposed system is indeed able to recover melodic information lost to its single-pitch tracking counterpart, and also outperforms another state-of-the-art melody extraction system designed for polyphonic music.Keywords
This publication has 27 references indexed in Scilit:
- Singer melody extraction in polyphonic signals using source separation methods2008
- Melody Detection in Polyphonic Musical Signals: Exploiting Perceptual Rules, Note Salience, and Melodic SmoothnessComputer Music Journal, 2006
- F0 Estimation Method for Singing Voice in Polyphonic Audio Signal Based on Statistical Vocal Model and Viterbi Search2006
- A real-time music-scene-description system: predominant-F0 estimation for detecting melody and bass lines in real-world audio signalsSpeech Communication, 2004
- Multiple fundamental frequency estimation based on harmonicity and spectral smoothnessIEEE Transactions on Speech and Audio Processing, 2003
- A multipitch tracking algorithm for noisy speechIEEE Transactions on Speech and Audio Processing, 2003
- A computationally efficient multipitch analysis modelIEEE Transactions on Speech and Audio Processing, 2000
- Musical fundamental frequency tracking using a pattern recognition methodThe Journal of the Acoustical Society of America, 1992
- Speech analysis/Synthesis based on a sinusoidal representationIEEE Transactions on Acoustics, Speech, and Signal Processing, 1986
- Maximum likelihood pitch estimationIEEE Transactions on Acoustics, Speech, and Signal Processing, 1976