The Impact of Multiple Parallel Phrase Suggestions on Email Input and Composition Behaviour of Native and Non-Native English Writers
Authors:
Top Cited Papers
Open Access
- 6 May 2021
- conference paper
- Published by Association for Computing Machinery (ACM)
- p. 1-13
Abstract
We present an in-depth analysis of the impact of multi-word suggestion choices from a neural language model on user behaviour regarding input and text composition in email writing. Our study for the first time compares different numbers of parallel suggestions, and use by native and non-native English writers, to explore a trade-off of “efficiency vs ideation”, emerging from recent literature. We built a text editor prototype with a neural language model (GPT-2), refined in a prestudy with 30 people. In an online study (N=156), people composed emails in four conditions (0/1/3/6 parallel suggestions). Our results reveal (1) benefits for ideation, and costs for efficiency, when suggesting multiple phrases; (2) that non-native speakers benefit more from more suggestions; and (3) further insights into behaviour patterns. We discuss implications for research, the design of interactive suggestion systems, and the vision of supporting writers with AI instead of replacing them.Keywords
All Related Versions
Funding Information
- Bavarian State Ministry of Science and the Arts
This publication has 56 references indexed in Scilit:
- Text Entry on the Edge2015
- VelociTap2015
- Effects of Language Modeling and its Personalization on Touchscreen Typing Performance2015
- 12 Production media: Writing as using tools in media convergent environments2014
- Complementing text entry evaluations with a composition taskACM Transactions on Computer-Human Interaction, 2014
- Multidimensional pareto optimization of touchscreen keyboards for speed, familiarity and improved spell checking2012
- User Interaction with Word PredictionACM Transactions on Accessible Computing, 2009
- Selecting hidden Markov model state number with cross-validated likelihoodComputational Statistics, 2007
- Small latin squares, quasigroups, and loopsJournal of Combinatorial Designs, 2006
- A Cognitive Process Theory of WritingCollege Composition and Communication, 1981