Prosody Modifications for Question-Answering in Voice-Only Settings
Preprint
Abstract
Many popular form factors of digital assistants---such as Amazon Echo, Apple Homepod, or Google Home---enable the user to hold a conversation with these systems based only on the speech modality. The lack of a screen presents unique challenges. To satisfy the information need of a user, the presentation of the answer needs to be optimized for such voice-only interactions. In this paper, we propose a task of evaluating the usefulness of audio transformations (i.e., prosodic modifications) for voice-only question answering. We introduce a crowdsourcing setup where we evaluate the quality of our proposed modifications along multiple dimensions corresponding to the informativeness, naturalness, and ability of the user to identify key parts of the answer. We offer a set of prosodic modifications that highlight potentially important parts of the answer using various acoustic cues. Our experiments show that some of these prosodic modifications lead to better comprehension at the expense of only slightly degraded naturalness of the audio.Keywords
All Related Versions
This publication has 11 references indexed in Scilit:
- A knowledge graph based speech interface for question answering systemsSpeech Communication, 2017
- Incorporating Clicks, Attention and Satisfaction into a Search Engine Result Page Evaluation Model2016
- Perception of Sentence Stress in Speech Correlates With the Temporal Unpredictability of Prosodic FeaturesCognitive Science, 2015
- Predictability affects early perceptual processing of word onsets in continuous speechNeuropsychologia, 2011
- Why Um Helps Auditory Word Recognition: The Temporal Delay HypothesisPLOS ONE, 2011
- Signal-based and expectation-based factors in the perception of prosodic prominenceLaboratory Phonology, 2010
- Prosody-driven Sentence Processing: An Event-related Brain Potential StudyJournal of Cognitive Neuroscience, 2005
- Understanding Mobile Human-Computer Interaction2005
- Prosodic Phrasing and ComprehensionLanguage and Speech, 1997
- On the Role of Sentence Stress in Sentence ProcessingLanguage and Speech, 1977