Confidence scoring for ANN-based spoken language understanding
Authors:
- 7 September 2004
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 16, 566-571
Abstract
In this paper, we present an efficient way for confidence scoring in a new spoken language understanding (SLU) approach. The SLU system is based on a combination of weighted finite state automata and an artificial neural network (ANN). Given an input sentence, the system extracts a set of semantic frames, called concepts ,a nd a user intention, called a goal. The confidence scoring is applied for detecting the goals misclassified by the neural network. A set of confidence features is derived from the outcomes of the SLU system, and is automatically selected for confidence scoring. Two classifiers, the Fisher linear discriminant analysis and the support vector machines (SVM), are compared. Experiments show that when we evaluate on a speech-recognized sentence set that contains about 23% word errors, the SVM achieves over 70% correct rejection of misunderstood sentences at 93% correct acceptance rate.Keywords
This publication has 4 references indexed in Scilit:
- Combination of finite state automata and neural network for spoken language understanding2003
- Neural-network based measures of confidence for word recognition2002
- Word and phone level acoustic confidence scoring2002
- Recognition confidence scoring and its use in speech understanding systemsComputer Speech & Language, 2002