Comparing Sentence-Level Suggestions to Message-Level Suggestions in AI-Mediated Communication
Top Cited Papers
Open Access
- 19 April 2023
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Abstract
Traditionally, writing assistance systems have focused on short or even single-word suggestions. Recently, large language models like GPT-3 have made it possible to generate significantly longer natural-sounding suggestions, offering more advanced assistance opportunities. This study explores the trade-offs between sentence- vs. message-level suggestions for AI-mediated communication. We recruited 120 participants to act as staffers from legislators’ offices who often need to respond to large volumes of constituent concerns. Participants were asked to reply to emails with different types of assistance. The results show that participants receiving message-level suggestions responded faster and were more satisfied with the experience, as they mainly edited the suggested drafts. In addition, the texts they wrote were evaluated as more helpful by others. In comparison, participants receiving sentence-level assistance retained a higher sense of agency, but took longer for the task as they needed to plan the flow of their responses and decide when to use suggestions. Our findings have implications for designing task-appropriate communication assistance systems.Keywords
All Related Versions
This publication has 32 references indexed in Scilit:
- On Suggesting Phrases vs. Predicting Words for Mobile Text Composition2016
- Smart Reply2016
- A Cost-Benefit Study of Text Entry Suggestion Interaction2016
- VelociTap2015
- Effects of Language Modeling and its Personalization on Touchscreen Typing Performance2015
- Explaining Explanations: How Legislators Explain their Policy Positions and How Citizens ReactAmerican Journal of Political Science, 2014
- The inviscid text entry rate and its application as a grand goal for mobile text entry2014
- Multidimensional pareto optimization of touchscreen keyboards for speed, familiarity and improved spell checking2012
- Role of the New Media in the Arab SpringGlobalizations, 2011
- Bringing text input beyond the desktop2000