Speech and crosstalk detection in multichannel audio
- 20 December 2004
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Speech and Audio Processing
- Vol. 13 (1) , 84-91
Abstract
The analysis of scenarios in which a number of microphones record the activity of speakers, such as in a round-table meeting, presents a number of computational challenges. For example, if each participant wears a microphone, speech from both the microphone's wearer (local speech) and from other participants (crosstalk) is received. The recorded audio can be broadly classified in four ways: local speech, crosstalk plus local speech, crosstalk alone and silence. We describe two experiments related to the automatic classification of audio into these four classes. The first experiment attempted to optimize a set of acoustic features for use with a Gaussian mixture model (GMM) classifier. A large set of potential acoustic features were considered, some of which have been employed in previous studies. The best-performing features were found to be kurtosis, "fundamentalness," and cross-correlation metrics. The second experiment used these features to train an ergodic hidden Markov model classifier. Tests performed on a large corpus of recorded meetings show classification accuracies of up to 96%, and automatic speech recognition performance close to that obtained using ground truth segmentation.Keywords
This publication has 16 references indexed in Scilit:
- Meetings about meetings: research at ICSI on speech in multiparty conversations2004
- The ICSI Meeting Corpus2003
- Automatic talker activity labeling for co-channel talker interference suppression2002
- Use of local kurtosis measure for spotting usable speech segments in co-channel speech2002
- Cochannel speaker count labelling based on the use of cepstral and pitch prediction derived featuresPattern Recognition, 2001
- Restructuring speech representations using a pitch-adaptive time–frequency smoothing and an instantaneous-frequency-based F0 extraction: Possible role of a repetitive structure in soundsSpeech Communication, 1999
- Speech separation by kurtosis maximization1998
- Cochannel speaker separation by harmonic enhancement and suppressionIEEE Transactions on Speech and Audio Processing, 1997
- Application of an LPC distance measure to the voiced-unvoiced-silence detection problemIEEE Transactions on Acoustics, Speech, and Signal Processing, 1977
- Separation of speech from interfering speech by means of harmonic selectionThe Journal of the Acoustical Society of America, 1976