Gregory A. Sanders
Current Organizations / Institutes
The organizations/institutes from the scholar's latest article
Previous Organizations / Institutes
The organizations / institutes from the scholar's other articles in the past ten years
Research Subjects
Research Interests
Gregory A. Sanders has a total of 8 co-authors. Here are the top co-authors by number of shared publications:
- Audrey N. Le
National Institute of Standards and Technology, Gaithersburg, Maryland, USA
2 shared publications - Brian A. Weiss
National Institute of Standards and Technology, Gaithersburg, Maryland, 20899, USA
1 shared publication - Craig Schlenoff
National Institute of Standards and Technology
1 shared publication - Kay Peterson
National Institute of Standards and Technology
1 shared publication - Mark Przybocki
National Institute of Standards and Technology
1 shared publication - Michelle Potts Steves
National Institute of Standards and Technology, 100 Bureau Drive, Gaithersburg, MD 20899, USA
1 shared publication
Latest Publications
- 7 May 2011
- Published by Elsevier in Computer Speech & Language
- Vol. 27 (2) , 528-553
Evaluation methodology and metrics employed to assess the TRANSTAC two-way, speech-to-speech translation systems
- 7 May 2011
- Published by Elsevier in Computer Speech & Language
- Vol. 27 (2) , 528-553
Evaluation methodology and metrics employed to assess the TRANSTAC two-way, speech-to-speech translation systems
- 1 September 2009
- Published by Springer Nature in Machine Translation
- Vol. 23 (2-3) , 71-103
The NIST 2008 Metrics for machine translation challenge—overview, methodology, metrics, and results
- 1 September 2009
- Published by Springer Nature in Machine Translation
- Vol. 23 (2-3) , 71-103
The NIST 2008 Metrics for machine translation challenge—overview, methodology, metrics, and results
- 1 October 2004
- Published by Springer Nature in International Journal of Speech Technology
- Vol. 7 (4) , 293-309
Effects of Speech Recognition Accuracy on the Performance of DARPA Communicator Spoken Dialogue Systems
- 1 October 2004
- Published by Springer Nature in International Journal of Speech Technology
- Vol. 7 (4) , 293-309
Effects of Speech Recognition Accuracy on the Performance of DARPA Communicator Spoken Dialogue Systems
- 1 January 2004
- Published by Defense Technical Information Center (DTIC)
Effects of Speech Recognition Accuracy on the Performance of DARPA Communicator Spoken Dialogue Systems
The DARPA Communicator program explored ways to construct better spoken-dialogue systems, with which users interact via speech alone to perform relatively complex tasks such as travel planning. During 2000 and 2001 two large data sets were collected from sessions in which paid users did travel planning using the Communicator systems that had been built by eight research groups. The research groups improved their systems intensively during the ten months between the two data collections. In this paper, we analyze these data sets to estimate the effects of speech recognition accuracy, as measured by Word Error Rate (WER), on other metrics. The effects that we found were linear. We found correlation between WER and Task Completion, and that correlation, unexpectedly, remained more or less linear even for high values of WER. The picture for User Satisfaction metrics is more complex: we found little effect of WER on User Satisfaction for WER less than about 35% to 40% in the 2001 data. The size of the effect of WER on Task Completion was less in 2001 than in 2000, and we believe this difference is due to improved strategies for accomplishing tasks despite speech recognition errors, which is an important accomplishment of the research groups who built the Communicator implementations. We show that additional factors must account for much of the variability in task success, and we present multivariate linear regression models for task success on the 2001 data. We also discuss the apparent gaps in the coverage of our metrics for spoken dialogue systems.
- 1 January 2004
- Published by Defense Technical Information Center (DTIC)
Effects of Speech Recognition Accuracy on the Performance of DARPA Communicator Spoken Dialogue Systems
The DARPA Communicator program explored ways to construct better spoken-dialogue systems, with which users interact via speech alone to perform relatively complex tasks such as travel planning. During 2000 and 2001 two large data sets were collected from sessions in which paid users did travel planning using the Communicator systems that had been built by eight research groups. The research groups improved their systems intensively during the ten months between the two data collections. In this paper, we analyze these data sets to estimate the effects of speech recognition accuracy, as measured by Word Error Rate (WER), on other metrics. The effects that we found were linear. We found correlation between WER and Task Completion, and that correlation, unexpectedly, remained more or less linear even for high values of WER. The picture for User Satisfaction metrics is more complex: we found little effect of WER on User Satisfaction for WER less than about 35% to 40% in the 2001 data. The size of the effect of WER on Task Completion was less in 2001 than in 2000, and we believe this difference is due to improved strategies for accomplishing tasks despite speech recognition errors, which is an important accomplishment of the research groups who built the Communicator implementations. We show that additional factors must account for much of the variability in task success, and we present multivariate linear regression models for task success on the 2001 data. We also discuss the apparent gaps in the coverage of our metrics for spoken dialogue systems.