Exploring Conversational Search With Humans, Assistants, and Wizards
Authors:
Open Access
- 6 May 2017
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 2187-2193
Abstract
Chatbots and conversational assistants are becoming increasingly popular. However, for information seeking scenarios, these systems still have very limited conversational abilities, and primarily serve as proxies to existing web search engines. In this work, we ask: what would conversational search look like with a truly intelligent assistant? To begin answering this question empirically, we conduct a user study, in which 21 participants are each given 3 information seeking tasks to solve using a text-based chat interface. To complete each task, participants conversed with three conversational agents: an existing commercial system, a human expert, and a perceived experimental automatic system, backed by a human 'wizard' behind the curtain. The observations and insights of our study help us understand the aspirations of users and the limitations of the current conversational agents -- and to sharpen a frontier of work required to improve conversational assistants for search scenarios.Keywords
This publication has 12 references indexed in Scilit:
- What Do You Mean Exactly?2017
- A Theoretical Framework for Conversational Search2017
- The rise of social botsCommunications of the ACM, 2016
- Among the Machines2016
- "Like Having a Really Bad PA"2016
- Interacting with bots online: Users’ reactions to actions of automated programs in WikipediaComputers in Human Behavior, 2015
- Questions vs. Queries in Informational Search Tasks2015
- Is that a bot running the social media feed? Testing the differences in perceptions of communication quality for a human agent and a bot agent on TwitterComputers in Human Behavior, 2014
- 'Natural' search user interfacesCommunications of the ACM, 2011
- Social reactions toward people vs. computers: How mere lables shape interactionsComputers in Human Behavior, 2007