On the Improvement of Singing Voice Separation for Monaural Recordings Using the MIR-1K Dataset
Authors:
Top Cited Papers
- 30 June 2009
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Audio, Speech, and Language Processing
- Vol. 18 (2) , 310-319
Abstract
Monaural singing voice separation is an extremely challenging problem. While efforts in pitch-based inference methods have led to considerable progress in voiced singing voice separation, little attention has been paid to the incapability of such methods to separate unvoiced singing voice due to its in harmonic structure and weaker energy. In this paper, we proposed a systematic approach to identify and separate the unvoiced singing voice from the music accompaniment. We have also enhanced the performance of separating voiced singing via a spectral subtraction method. The proposed system follows the framework of computational auditory scene analysis (CASA) which consists of the segmentation stage and the grouping stage. In the segmentation stage, the input song signals are decomposed into small sensory elements in different time-frequency resolutions. The unvoiced sensory elements are then identified by Gaussian mixture models. The experimental results demonstrated that the quality of the separated singing voice is improved for both the unvoiced and voiced parts. Moreover, to deal with the problem of lack of a publicly available dataset for singing voice separation, we have constructed a corpus called MIR-1K (multimedia information retrieval lab, 1000 song clips) where all singing voices and music accompaniments were recorded separately. Each song clip comes with human-labeled pitch values, unvoiced sounds and vocal/non-vocal segments, and lyrics, as well as the speech recording of the lyrics.Keywords
This publication has 14 references indexed in Scilit:
- Segregation of unvoiced speech from nonspeech interferenceThe Journal of the Acoustical Society of America, 2008
- Accompaniment separation and karaoke application based on automatic melody transcription2008
- Separation of Singing Voice From Music Accompaniment for Monaural RecordingsIEEE Transactions on Audio, Speech, and Language Processing, 2007
- PHONETIC AND PHONOLOGICAL BACKGROUND OF CHINESE SPOKEN LANGUAGES2006
- On Ideal Binary Mask As the Computational Goal of Auditory Scene Analysis2006
- Automatic Synchronization between Lyrics and Music CD Recordings Based on Viterbi Alignment of Segregated Vocal Signals2006
- Monaural Speech Segregation Based on Pitch Tracking and Amplitude ModulationIEEE Transactions on Neural Networks, 2004
- Speech enhancement based on a priori signal to noise estimation2002
- A tutorial on hidden Markov models and selected applications in speech recognitionProceedings of the IEEE, 1989
- Least squares quantization in PCMIEEE Transactions on Information Theory, 1982