Vocabulary-independent indexing of spontaneous speech
Authors:
- Chengyuan MaCMChengyuan Ma
- F. SeideFSF. Seide
- 15 August 2005
- journal article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Transactions on Speech and Audio Processing
- Vol. 13 (5) , 635-643
Abstract
We present a system for vocabulary-independent indexing of spontaneous speech, i.e., neither do we know the vocabulary of a speech recording nor can we predict which query terms for which a user is going to search. The technique can be applied to information retrieval, information extraction, and data mining. Our specific target is search in recorded conversations in the office/information-worker scenario-teleconferences, meetings, presentations, and voice mails. The focus of this paper is on how to index phonetic lattices. We will show that an index should provide expected term frequencies (ETFs) of query terms. Since, at indexing time, it is unknown which phoneme sequences constitute valid query terms, we will introduce an approximation of ETFs of a query's phoneme sequence by M-gram phoneme language models, which are estimated on lattices and organized in an inverted index-like structure for fast access. We will discuss ranking, estimation, and integration of phoneme/word hybrid approaches. Compared with an unindexed baseline without approximation, our approximation leads only to a 3.4% relative loss of search accuracy on the Linguistic Data Consortium (LDC) voicemail task. We also propose a two-stage method for locating individual keyword occurrences using the above method as a fast match. A 20-times speedup is achieved over unindexed search at under a 2-point accuracy loss. Last, we will briefly introduce a prototype applet based on the above techniques.Keywords
This publication has 11 references indexed in Scilit:
- General indexation of weighted automata2010
- Vocabulary-independent search in spontaneous speech2004
- A comparison of time conditioned and word conditioned search techniques for large vocabulary speech recognition2002
- A fast lattice-based approach to vocabulary independent wordspotting2002
- Large vocabulary decoding and confidence estimation using word posterior probabilities2002
- A multistage algorithm for spotting new words in speechIEEE Transactions on Speech and Audio Processing, 2002
- Word and sub-word indexing approaches for reducing the effects of OOV queries on spoken audio2002
- Using posterior word probabilities for improved speech recognition2000
- A comparison of several approximate algorithms for finding multiple (N-best) sentence hypotheses1991
- THE PROBABILITY RANKING PRINCIPLE IN IRJournal of Documentation, 1977